-- Logs begin at Mon 2022-07-25 20:35:24 UTC, end at Mon 2022-07-25 21:48:24 UTC. -- Jul 25 21:20:48.227984 dv-osbrick-849018-3-ceph systemd[1]: Starting Devstack devstack@keystone.service... Jul 25 21:20:48.235598 dv-osbrick-849018-3-ceph devstack@keystone.service[87202]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 25 21:20:48.239478 dv-osbrick-849018-3-ceph devstack@keystone.service[87202]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jul 25 21:20:48 2022] *** Jul 25 21:20:48.239478 dv-osbrick-849018-3-ceph devstack@keystone.service[87202]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 25 21:20:48.239478 dv-osbrick-849018-3-ceph devstack@keystone.service[87202]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 25 21:20:48.239478 dv-osbrick-849018-3-ceph devstack@keystone.service[87202]: nodename: dv-osbrick-849018-3-ceph Jul 25 21:20:48.239478 dv-osbrick-849018-3-ceph devstack@keystone.service[87202]: machine: x86_64 Jul 25 21:20:48.239478 dv-osbrick-849018-3-ceph devstack@keystone.service[87202]: clock source: unix Jul 25 21:20:48.239478 dv-osbrick-849018-3-ceph devstack@keystone.service[87202]: pcre jit disabled Jul 25 21:20:48.239478 dv-osbrick-849018-3-ceph devstack@keystone.service[87202]: detected number of CPU cores: 4 Jul 25 21:20:48.239478 dv-osbrick-849018-3-ceph devstack@keystone.service[87202]: current working directory: / Jul 25 21:20:48.239478 dv-osbrick-849018-3-ceph devstack@keystone.service[87202]: detected binary path: /usr/bin/uwsgi-core Jul 25 21:20:48.239478 dv-osbrick-849018-3-ceph devstack@keystone.service[87202]: your processes number limit is 47680 Jul 25 21:20:48.239478 dv-osbrick-849018-3-ceph devstack@keystone.service[87202]: your memory page size is 4096 bytes Jul 25 21:20:48.239478 dv-osbrick-849018-3-ceph devstack@keystone.service[87202]: detected max file descriptor number: 2048 Jul 25 21:20:48.239478 dv-osbrick-849018-3-ceph devstack@keystone.service[87202]: lock engine: pthread robust mutexes Jul 25 21:20:48.239478 dv-osbrick-849018-3-ceph devstack@keystone.service[87202]: thunder lock: enabled Jul 25 21:20:48.239478 dv-osbrick-849018-3-ceph devstack@keystone.service[87202]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 25 21:20:48.239478 dv-osbrick-849018-3-ceph devstack@keystone.service[87202]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 25 21:20:48.282749 dv-osbrick-849018-3-ceph devstack@keystone.service[87202]: Python main interpreter initialized at 0x5573182479c0 Jul 25 21:20:48.282749 dv-osbrick-849018-3-ceph devstack@keystone.service[87202]: python threads support enabled Jul 25 21:20:48.282749 dv-osbrick-849018-3-ceph devstack@keystone.service[87202]: your server socket listen backlog is limited to 100 connections Jul 25 21:20:48.282749 dv-osbrick-849018-3-ceph devstack@keystone.service[87202]: your mercy for graceful operations on workers is 90 seconds Jul 25 21:20:48.283099 dv-osbrick-849018-3-ceph devstack@keystone.service[87202]: mapped 403077 bytes (393 KB) for 2 cores Jul 25 21:20:48.283174 dv-osbrick-849018-3-ceph devstack@keystone.service[87202]: *** Operational MODE: preforking *** Jul 25 21:20:48.283420 dv-osbrick-849018-3-ceph devstack@keystone.service[87202]: *** uWSGI is running in multiple interpreter mode *** Jul 25 21:20:48.283420 dv-osbrick-849018-3-ceph devstack@keystone.service[87202]: spawned uWSGI master process (pid: 87202) Jul 25 21:20:48.283701 dv-osbrick-849018-3-ceph systemd[1]: Started Devstack devstack@keystone.service. Jul 25 21:20:48.285273 dv-osbrick-849018-3-ceph devstack@keystone.service[87202]: spawned uWSGI worker 1 (pid: 87209, cores: 1) Jul 25 21:20:48.285273 dv-osbrick-849018-3-ceph devstack@keystone.service[87202]: spawned uWSGI worker 2 (pid: 87210, cores: 1) Jul 25 21:20:48.285273 dv-osbrick-849018-3-ceph devstack@keystone.service[87202]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 25 21:20:54.001103 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 21:20:54.001103 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: from cryptography.utils import int_from_bytes Jul 25 21:20:54.001882 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 21:20:54.001882 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: from cryptography.utils import int_from_bytes Jul 25 21:20:54.033340 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 21:20:54.033340 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: from cryptography.utils import int_from_bytes Jul 25 21:20:54.033940 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 21:20:54.033940 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: from cryptography.utils import int_from_bytes Jul 25 21:20:54.051687 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 25 21:20:54.051876 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 25 21:20:54.052059 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] command line args: [] {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 25 21:20:54.052325 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 25 21:20:54.052498 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] ================================================================================ {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 25 21:20:54.052756 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] admin_token = **** {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:20:54.053001 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] config_dir = [] {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:20:54.053211 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:20:54.053389 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] config_source = [] {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:20:54.053563 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] debug = True {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:20:54.053756 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:20:54.054119 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:20:54.054294 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] insecure_debug = False {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:20:54.054542 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:20:54.054816 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:20:54.055016 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] list_limit = None {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:20:54.055212 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] log_config_append = None {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:20:54.055373 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:20:54.055559 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] log_dir = None {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:20:54.055719 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] log_file = None {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:20:54.055964 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:20:54.056174 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:20:54.056447 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:20:54.056688 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:20:54.056816 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:20:54.057016 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:20:54.057295 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:20:54.057539 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:20:54.057771 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:20:54.057976 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:20:54.058232 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:20:54.058439 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:20:54.058676 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:20:54.058916 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] notification_format = cadf {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:20:54.059192 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:20:54.059671 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.66/identity {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:20:54.059846 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] publish_errors = False {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:20:54.060071 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:20:54.060283 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:20:54.060456 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:20:54.060696 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:20:54.060924 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:20:54.061179 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] standard_threads = False {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:20:54.061408 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] strict_password_check = False {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:20:54.061646 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:20:54.061818 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] use_eventlog = False {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:20:54.061990 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] use_journal = False {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:20:54.062163 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] use_json = False {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:20:54.062334 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] use_stderr = False {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:20:54.062506 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] use_syslog = False {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:20:54.062731 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] watch_log_file = False {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:20:54.062982 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.063216 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.063471 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.063705 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.063949 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.064181 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.064424 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.064703 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.065059 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.065331 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.065582 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.065970 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.066157 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.066267 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.066510 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.066753 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.066985 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.067234 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.067481 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.067721 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.067953 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.068200 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.068465 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.068714 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.068959 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.069209 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.069436 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.069660 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.069889 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.070133 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.070377 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.070601 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.070826 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.071068 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.071310 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.071541 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.071783 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.072011 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.072244 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.072473 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.072699 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.072924 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.073171 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.073399 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.073630 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.073872 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.074096 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.074327 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.074550 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.074781 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.075010 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.075250 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.075475 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.075711 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.075942 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.076171 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.076400 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.076635 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.076860 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.077120 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.077355 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.077587 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.077809 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.078063 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.078295 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.078520 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.078752 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.079001 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.079265 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.079505 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.079750 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.079993 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.080222 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.080551 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.080835 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.081095 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] cache.enabled = True {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.081337 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.081570 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.081810 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.082042 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.082275 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.082506 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.082736 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.082966 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.083225 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.083314 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 25 21:20:54.083462 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 25 21:20:54.083539 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.083663 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] command line args: [] {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 25 21:20:54.083747 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.083918 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.084003 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 25 21:20:54.084097 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] ================================================================================ {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 25 21:20:54.084173 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.084353 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] admin_token = **** {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:20:54.084437 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.084589 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.084674 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] config_dir = [] {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:20:54.084774 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:20:54.084860 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.084976 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] config_source = [] {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:20:54.085055 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.085152 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] debug = True {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:20:54.085279 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.085364 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:20:54.085500 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.085585 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:20:54.085730 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] insecure_debug = False {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:20:54.085818 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.085953 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.086029 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:20:54.086185 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.086262 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:20:54.086416 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.086495 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] list_limit = None {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:20:54.086632 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] log_config_append = None {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:20:54.086712 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.086785 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:20:54.086857 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.086936 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] log_dir = None {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:20:54.087090 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] log_file = None {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:20:54.087234 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.087312 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:20:54.087496 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.087580 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:20:54.087726 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.087801 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:20:54.087950 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] auth.external = None {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.088034 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:20:54.088176 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] auth.mapped = None {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.088254 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:20:54.088336 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:20:54.088469 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.088577 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:20:54.088700 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.088823 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:20:54.088928 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] auth.password = None {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.089055 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:20:54.089173 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] auth.token = None {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.089315 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:20:54.089394 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.089547 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:20:54.089624 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] catalog.caching = True {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.089777 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:20:54.089856 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.090020 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:20:54.090098 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.090266 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] notification_format = cadf {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:20:54.090350 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.090529 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.090605 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:20:54.090758 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.090990 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] credential.caching = True {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.091067 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.66/identity {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:20:54.091192 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] publish_errors = False {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:20:54.091269 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] credential.driver = sql {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.091425 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:20:54.091532 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.091654 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:20:54.091741 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.091814 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:20:54.091919 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.092063 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:20:54.092142 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.092295 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:20:54.092380 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.092527 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] standard_threads = False {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:20:54.092605 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.092758 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] strict_password_check = False {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:20:54.092858 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.093000 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:20:54.093108 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.093217 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] use_eventlog = False {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:20:54.093349 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.093428 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] use_journal = False {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:20:54.093554 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] use_json = False {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:20:54.093631 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.093728 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] use_stderr = False {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:20:54.093856 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.093934 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] use_syslog = False {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:20:54.094116 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.094194 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] watch_log_file = False {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:20:54.094355 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.094448 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.094596 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.094674 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.094825 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] federation.caching = True {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.094902 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.095061 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.095148 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.095304 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] federation.driver = sql {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.095382 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.095537 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.095614 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.095773 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.095858 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.096088 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.096170 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.096404 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.096547 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.096663 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.096874 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.096956 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.097149 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.097232 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.097391 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.097478 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.097638 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.097724 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.097872 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] identity.caching = True {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.097956 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.098116 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.098201 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.098360 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.098439 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.098598 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.098726 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.098828 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.098908 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.099071 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] identity.driver = sql {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.099153 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.099298 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.099384 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.099530 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.099609 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.099976 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.100059 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.100132 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.100203 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.100274 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.100345 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.100489 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.100576 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.100657 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.100730 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.100868 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.100954 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.101128 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.101221 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.101373 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.101451 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.101621 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.101703 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.101863 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.101949 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.102095 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.102171 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.102325 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.102403 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.102561 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.102646 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.102787 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.102865 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.103019 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.103097 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.103285 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.103432 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.103563 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.103696 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.104294 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.104294 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.105509 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.105699 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.105829 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.106397 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.107117 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.107202 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.107276 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.107348 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.107419 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.107499 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.107573 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.107645 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.107716 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.107788 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.107788 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.107926 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.107999 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.108071 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.108142 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] ldap.password = **** {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.108214 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.108285 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.108285 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.108423 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.108502 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.108586 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.108659 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.108731 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.108820 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.108894 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.108965 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.109035 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.109138 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.109215 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.109300 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.109375 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.109446 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.109517 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.109587 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.109658 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.109737 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.109810 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.109881 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.109952 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.110023 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.110096 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.110175 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.110247 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.110318 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] ldap.user = None {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.110389 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.110464 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.110546 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.110628 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.110709 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.110782 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.110852 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.110924 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.110995 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.111074 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.111146 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.111217 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.111288 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.111365 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.111438 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.111557 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.111638 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.111710 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.111831 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.111917 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.111991 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.112073 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.112148 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.112374 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.112499 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.112579 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.112652 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.112841 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.112967 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.113047 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.113153 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] cache.enabled = True {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.113334 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.113460 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.113631 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.113719 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.113800 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.113873 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.113985 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.114073 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.114232 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.114357 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.114437 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.114510 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.114684 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.114809 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.114907 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.114992 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.115152 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.115285 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.115368 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.115460 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.115625 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.115749 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] policy.driver = sql {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.115830 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.115903 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.116073 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.116211 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.116294 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.116375 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.116522 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] receipt.caching = True {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.116647 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.116727 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.116813 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.116962 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.117119 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.117202 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.117276 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.117434 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.117579 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.117661 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.117735 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.117870 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] resource.caching = True {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.117954 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.118108 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.118199 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.118345 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.118435 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] resource.driver = sql {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.118571 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.118653 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.118814 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.118907 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.119058 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.119142 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.119285 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] revoke.caching = True {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.119368 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.119528 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.119619 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.119756 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] auth.external = None {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.119838 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.119989 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] auth.mapped = None {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.120072 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] role.cache_time = None {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.120223 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] role.caching = True {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.120392 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.120477 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] role.driver = sql {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.120628 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.120711 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] role.list_limit = None {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.120863 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] auth.password = None {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.120948 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.121133 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] auth.token = None {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.121218 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.121343 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.121424 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.121582 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] catalog.caching = True {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.121661 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.121831 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.121918 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.122060 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.122139 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.122299 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.122377 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.122541 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.122627 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.122767 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.122845 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.123002 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] credential.caching = True {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.123080 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.123239 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.123319 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] credential.driver = sql {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.123480 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.123559 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.123721 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.123799 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.123964 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.124124 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.124203 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.124359 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.124437 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.124604 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.124684 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.124850 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.124928 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.125109 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.125192 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.125359 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.125441 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.125593 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.125672 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.125841 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.125920 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.126089 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.126169 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.126320 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.126399 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.126636 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.127046 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.127138 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] federation.caching = True {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.127260 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.127335 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.127407 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.127479 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] federation.driver = sql {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.127551 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.127812 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.127948 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.128068 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.128161 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.128283 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.128410 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.128499 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.128653 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.128738 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] token.cache_time = None {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.128910 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.128988 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] token.caching = True {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.129168 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.129264 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.129425 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] token.provider = fernet {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.129503 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.129657 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.129734 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.129901 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.129986 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.130140 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] identity.caching = True {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.130218 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.130369 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.130446 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.130609 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.130700 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.130847 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.130932 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.131080 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.131156 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] trust.driver = sql {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.131307 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.131396 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] identity.driver = sql {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.131541 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.131620 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.131770 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.131848 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.132012 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.132098 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.132256 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.132342 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.132481 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.132560 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.132708 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.132793 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.132936 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.133015 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.133202 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.133284 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] database.connection = **** {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.133452 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.133541 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.133698 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.133778 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.133951 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.134027 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.134196 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.134272 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.134416 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.134491 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.134644 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.134723 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.134874 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.134952 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.135105 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.135184 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.135343 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.135420 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.135574 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.135655 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.135813 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.135891 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.136042 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.136120 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.136281 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.136357 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.136508 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.136587 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.136745 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.136822 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.136965 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.137042 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.137226 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.137308 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.137456 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.137535 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.137607 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 25 21:20:54.137708 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.137956 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.138187 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.138425 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.138654 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] ldap.password = **** {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.138889 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.139124 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.139367 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.139602 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.139838 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.140097 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.140350 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.140581 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.140829 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.141057 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.141329 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.141564 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.141800 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.142038 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.142269 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] ldap.user = None {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.142510 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.142797 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.143133 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.143651 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.143871 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.144123 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.144361 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.144593 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.144830 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.145068 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.145339 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.145570 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.145818 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.146065 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.146312 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.146560 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.146806 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.147036 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.147280 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.147515 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.147748 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.147983 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.148218 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.148461 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.148720 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.148957 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.149315 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] policy.driver = sql {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.149548 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.149793 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.150030 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.150272 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] receipt.caching = True {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.150507 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.150754 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.151003 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.151238 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.151474 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.151717 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] resource.caching = True {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.151967 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.152217 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] resource.driver = sql {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.152452 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.152705 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.152955 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.153218 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] revoke.caching = True {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.153466 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.153702 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.153939 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] role.cache_time = None {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.154176 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] role.caching = True {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.154423 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] role.driver = sql {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.154653 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] role.list_limit = None {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.154900 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.155148 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.155396 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.155644 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.155889 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.156135 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.156379 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.156628 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.156860 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.157125 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.157375 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.157622 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.157869 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.158283 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.158589 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.159056 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.159381 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.159633 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.159889 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.160124 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.160378 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.160633 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.160871 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.161121 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.161355 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.161585 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.161835 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.162091 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.162340 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.162586 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.162826 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.163059 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] token.cache_time = None {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.163295 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] token.caching = True {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.163536 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.163785 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] token.provider = fernet {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.164034 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.164292 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.164542 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.164781 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.165025 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.165296 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.165865 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] trust.driver = sql {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.166102 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.166340 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.166574 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.166822 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.167045 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=87209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:20:54.167130 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.167270 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=87209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:20:54.167351 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.167488 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=87209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:20:54.167571 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.167798 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.168060 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] database.connection = **** {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.168302 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.168550 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.168787 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.169028 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.169288 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.169525 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.169765 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.170000 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.170245 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.170482 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.170724 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.170958 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.171206 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.171441 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.171684 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.171913 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.172152 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.172386 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:20:54.172556 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 25 21:20:54.176198 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=87209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:20:54.198330 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=87210) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:20:54.198609 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=87210) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:20:54.198700 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=87210) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:20:54.205588 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=87209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:20:54.205815 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=87209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:20:54.208945 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=87210) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:20:54.227339 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=87210) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:20:54.227568 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=87210) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:20:54.258915 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=87209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:20:54.265048 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=87210) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:20:54.309363 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=87209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:20:54.309568 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=87209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:20:54.313952 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=87210) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:20:54.314194 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=87210) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:20:54.374692 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:20:54.374862 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=87209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:20:54.375077 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87210) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:20:54.375182 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=87209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:20:54.375262 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=87210) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:20:54.375337 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=87209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:20:54.375446 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=87210) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:20:54.375537 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=87209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:20:54.375905 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=87210) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:20:54.376036 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=87209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:20:54.376138 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=87210) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:20:54.376138 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=87210) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:20:54.398691 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:20:54.398892 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=87209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:20:54.399071 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87210) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:20:54.399205 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=87209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:20:54.399277 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=87210) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:20:54.399356 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=87209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:20:54.399531 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=87209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:20:54.399655 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=87210) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:20:54.399726 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=87209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:20:54.399789 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=87210) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:20:54.399900 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:20:54.399988 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=87210) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:20:54.400155 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=87210) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:20:54.400380 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87210) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:20:54.411004 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=87209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:20:54.411648 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=87210) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:20:54.424017 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:20:54.424324 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=87209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:20:54.424423 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=87209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:20:54.424657 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=87209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:20:54.424897 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=87209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:20:54.425027 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87210) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:20:54.425223 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=87209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:20:54.425349 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=87210) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:20:54.425418 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:20:54.425481 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=87210) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:20:54.425714 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=87210) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:20:54.425938 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=87210) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:20:54.426135 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=87210) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:20:54.426370 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87210) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:20:54.442307 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=87209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.442490 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=87209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 25 21:20:54.442832 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=87209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.442978 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=87210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.443065 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=87209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 25 21:20:54.443132 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=87210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 25 21:20:54.443268 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=87209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.443406 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=87210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.443486 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=87209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.443560 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=87210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 25 21:20:54.443772 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=87209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.443899 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=87210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.444003 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=87209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.444093 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=87210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.444339 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=87210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.444575 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=87210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.453686 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=87209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.453910 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=87209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.454167 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=87209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.454291 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=87210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.454413 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=87209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.454506 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=87210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.454786 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=87210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.455062 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=87210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.463420 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=87209) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 21:20:54.463952 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=87210) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 21:20:54.466347 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=87209) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 21:20:54.466622 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=87209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.466899 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=87209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.467024 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=87210) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 21:20:54.467129 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=87210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.467208 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=87209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.467436 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=87209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.467561 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=87210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.467645 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=87209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.467735 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=87210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.467915 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=87209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.468010 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=87210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.468204 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=87209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.468330 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=87210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.468476 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=87210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.468620 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=87209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.468694 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=87209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.468771 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=87210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.468981 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=87209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.469136 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=87210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.469229 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=87210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.469508 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=87210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.491847 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=87209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.492936 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=87210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.493341 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=87209) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 21:20:54.493616 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=87209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.494446 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=87210) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 21:20:54.494725 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=87210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.498177 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=87209) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 21:20:54.498452 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=87209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.498725 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=87209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.499403 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=87210) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 21:20:54.499683 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=87210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.499962 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=87210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.505485 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=87209) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 21:20:54.505763 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=87209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.506927 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=87210) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 21:20:54.507208 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=87210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.509799 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=87209) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 21:20:54.510079 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=87209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.510374 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=87209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.510671 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=87209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.510944 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=87209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.511279 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=87210) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 21:20:54.511408 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=87209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.511553 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=87210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.511681 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=87209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.511826 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=87209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.511953 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=87210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.512096 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=87210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.512390 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=87210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.512756 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=87210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.513040 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=87210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.513342 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=87210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.527492 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=87209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.527763 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=87209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.531645 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=87209) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 21:20:54.532001 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=87210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.532278 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=87210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.535120 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=87209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.535417 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=87209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.536571 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=87210) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 21:20:54.539766 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=87210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.539892 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=87209) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 21:20:54.540042 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=87210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.543228 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=87209) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 21:20:54.544785 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=87210) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 21:20:54.546371 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=87209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.546661 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=87209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.546940 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=87209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.547221 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=87209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.547600 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=87209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.547877 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=87209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.548145 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=87210) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 21:20:54.551546 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=87210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.551850 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=87210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.552132 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=87210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.552411 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=87210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.552683 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=87210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.553117 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=87210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.563950 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=87209) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 21:20:54.564224 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=87209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.564490 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=87209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.564745 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=87209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.569308 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=87210) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 21:20:54.569612 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=87210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.569887 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=87210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.570138 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=87210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.571583 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=87209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.573283 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=87209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.573553 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=87209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.576212 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=87209) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 21:20:54.576488 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=87209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.576770 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=87209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.576909 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=87210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.577049 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=87209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.577349 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=87209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.578627 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=87210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.578925 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=87210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.582073 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=87210) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 21:20:54.582360 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=87210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.582651 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=87210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.582941 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=87210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.583218 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=87210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.588748 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=87209) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 21:20:54.589024 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=87209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.589323 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=87209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.589606 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=87209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.589879 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=87209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.590146 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=87209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.590429 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=87209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.594561 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=87210) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 21:20:54.594841 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=87210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.595115 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=87210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.595397 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=87210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.595638 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=87210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.596033 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=87210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.596364 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=87210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.606000 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=87209) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 21:20:54.609037 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=87209) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 21:20:54.612613 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=87210) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 21:20:54.613434 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=87209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.614889 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=87209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.615606 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=87210) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 21:20:54.616384 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=87209) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 21:20:54.616659 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=87209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.616934 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=87209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.619675 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=87210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.621181 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=87210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.622688 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=87210) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 21:20:54.622967 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=87210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.623257 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=87210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.728733 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=87209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.730166 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=87209) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 21:20:54.733008 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=87209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.733315 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=87209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.733597 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=87209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.733869 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=87209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.734715 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=87210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.736255 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=87210) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 21:20:54.739648 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=87210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.739943 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=87210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.740226 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=87210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.740495 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=87210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.742003 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=87209) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 21:20:54.742298 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=87209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.742576 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=87209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.748421 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=87210) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 21:20:54.748718 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=87210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.748994 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=87210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.749361 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=87209) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 21:20:54.749748 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=87209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.750024 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=87209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.750306 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=87209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.750573 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=87209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.750850 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=87209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.751102 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=87209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.751381 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=87209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.751761 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=87209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.752037 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=87209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.752344 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=87209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.752602 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=87209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.752865 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=87209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.753142 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=87209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.756001 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=87210) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 21:20:54.756394 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=87210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.756686 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=87210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.756964 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=87210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.757265 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=87210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.757548 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=87210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.757821 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=87210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.758095 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=87210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.758372 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=87210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.758643 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=87210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.758911 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=87210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.759217 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=87210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.759482 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=87210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.759741 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=87210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:20:54.786411 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5573182479c0 pid: 87209 (default app) Jul 25 21:20:54.790188 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e00d65-c566-465e-be81-8db71a010f83 None None] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:20:54.790784 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e00d65-c566-465e-be81-8db71a010f83 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:20:54.791055 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e00d65-c566-465e-be81-8db71a010f83 None None] PATH_INFO: `/v3` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:20:54.793701 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5573182479c0 pid: 87210 (default app) Jul 25 21:20:54.795283 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 1/1] 10.222.0.66 () {50 vars in 791 bytes} [Mon Jul 25 21:20:54 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:21:02.938346 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb02c8ab-8eff-4034-991e-acc926792e8f None None] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:02.939285 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb02c8ab-8eff-4034-991e-acc926792e8f None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:02.939428 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb02c8ab-8eff-4034-991e-acc926792e8f None None] PATH_INFO: `/` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:02.944331 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 1/2] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:21:02 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:21:02.950053 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c227b264-ae05-48d7-b7be-fa2cb05b7d93 None None] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:02.950498 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c227b264-ae05-48d7-b7be-fa2cb05b7d93 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:02.950603 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c227b264-ae05-48d7-b7be-fa2cb05b7d93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:03.026412 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: INFO dbcounter [None req-c227b264-ae05-48d7-b7be-fa2cb05b7d93 None None] Registered counter for database keystone Jul 25 21:21:03.051728 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG oslo_db.sqlalchemy.engines [None req-c227b264-ae05-48d7-b7be-fa2cb05b7d93 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87209) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 21:21:03.064052 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writer thread running {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 21:21:03.253151 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG passlib.handlers.bcrypt [None req-c227b264-ae05-48d7-b7be-fa2cb05b7d93 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=87209) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 25 21:21:03.253465 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG passlib.handlers.bcrypt [None req-c227b264-ae05-48d7-b7be-fa2cb05b7d93 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=87209) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 25 21:21:03.311463 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.auth.core [None req-c227b264-ae05-48d7-b7be-fa2cb05b7d93 None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:21:03.313130 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-c227b264-ae05-48d7-b7be-fa2cb05b7d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:21:03.447549 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 2/3] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:21:02 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 498 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jul 25 21:21:03.637558 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb02c8ab-8eff-4034-991e-acc926792e8f None None] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:03.717457 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: INFO dbcounter [None req-fb02c8ab-8eff-4034-991e-acc926792e8f None None] Registered counter for database keystone Jul 25 21:21:03.739554 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG oslo_db.sqlalchemy.engines [None req-fb02c8ab-8eff-4034-991e-acc926792e8f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87210) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 21:21:03.747145 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writer thread running {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 21:21:03.870304 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb02c8ab-8eff-4034-991e-acc926792e8f None None] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:03.875882 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76461911-a614-41a8-b3b3-0520b2256de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9501d798e8481da3be76351eec2bf6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:03.876523 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76461911-a614-41a8-b3b3-0520b2256de3 admin admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:03.876799 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76461911-a614-41a8-b3b3-0520b2256de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:03.877200 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76461911-a614-41a8-b3b3-0520b2256de3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:03.886781 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76461911-a614-41a8-b3b3-0520b2256de3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:03.938299 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: WARNING keystone.common.rbac_enforcer.enforcer [None req-76461911-a614-41a8-b3b3-0520b2256de3 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 25 21:21:03.938571 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76461911-a614-41a8-b3b3-0520b2256de3 admin admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:03.951327 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 2/4] 10.222.0.66 () {58 vars in 1324 bytes} [Mon Jul 25 21:21:03 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 21:21:03.958578 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c227b264-ae05-48d7-b7be-fa2cb05b7d93 None None] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:03.978675 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c227b264-ae05-48d7-b7be-fa2cb05b7d93 None None] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:03.984499 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af27d10b-3082-402d-ad44-0e31899f407f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9501d798e8481da3be76351eec2bf6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:03.985666 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af27d10b-3082-402d-ad44-0e31899f407f admin admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:03.985949 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af27d10b-3082-402d-ad44-0e31899f407f admin admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:03.986219 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af27d10b-3082-402d-ad44-0e31899f407f admin admin] PATH_INFO: `/v3/projects/fa9501d798e8481da3be76351eec2bf6` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:03.988313 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af27d10b-3082-402d-ad44-0e31899f407f admin admin] RBAC: Authorizing `identity:get_project(project_id=fa9501d798e8481da3be76351eec2bf6)` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:04.040508 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: WARNING keystone.common.rbac_enforcer.enforcer [None req-af27d10b-3082-402d-ad44-0e31899f407f admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 25 21:21:04.040869 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af27d10b-3082-402d-ad44-0e31899f407f admin admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:04.047884 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 3/5] 10.222.0.66 () {56 vars in 1207 bytes} [Mon Jul 25 21:21:03 2022] GET /identity/v3/projects/fa9501d798e8481da3be76351eec2bf6 => generated 344 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:21:06.255767 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358d03fb-794d-45e6-83ac-bbcefba4302d None None] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:06.258459 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358d03fb-794d-45e6-83ac-bbcefba4302d None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:06.258459 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358d03fb-794d-45e6-83ac-bbcefba4302d None None] PATH_INFO: `/` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:06.260424 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 3/6] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:21:06 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:21:06.267311 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b49d5f-a6d3-49dd-889d-f018dcec5404 None None] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:06.268183 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b49d5f-a6d3-49dd-889d-f018dcec5404 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:06.268183 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b49d5f-a6d3-49dd-889d-f018dcec5404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:06.302956 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.auth.core [None req-84b49d5f-a6d3-49dd-889d-f018dcec5404 None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:21:06.305538 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-84b49d5f-a6d3-49dd-889d-f018dcec5404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:21:06.318923 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 4/7] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:21:06 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 25 21:21:06.343419 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358d03fb-794d-45e6-83ac-bbcefba4302d None None] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:06.364918 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358d03fb-794d-45e6-83ac-bbcefba4302d None None] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:06.371357 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c965abca-763a-4f7c-b825-b217f1d1cdf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9501d798e8481da3be76351eec2bf6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:06.371979 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c965abca-763a-4f7c-b825-b217f1d1cdf7 admin admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:06.372256 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c965abca-763a-4f7c-b825-b217f1d1cdf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:06.372522 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c965abca-763a-4f7c-b825-b217f1d1cdf7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:06.382348 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c965abca-763a-4f7c-b825-b217f1d1cdf7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:06.384724 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c965abca-763a-4f7c-b825-b217f1d1cdf7 admin admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:06.397405 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 4/8] 10.222.0.66 () {58 vars in 1324 bytes} [Mon Jul 25 21:21:06 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 21:21:06.403293 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b49d5f-a6d3-49dd-889d-f018dcec5404 None None] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:06.413153 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b49d5f-a6d3-49dd-889d-f018dcec5404 None None] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:06.419639 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d492ec-7777-46ba-afe9-96ff0f39c992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9501d798e8481da3be76351eec2bf6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:06.420299 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d492ec-7777-46ba-afe9-96ff0f39c992 admin admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:06.420583 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d492ec-7777-46ba-afe9-96ff0f39c992 admin admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:06.420859 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d492ec-7777-46ba-afe9-96ff0f39c992 admin admin] PATH_INFO: `/v3/users/1e6cadb2f0fe422088a106e6a578b2f7` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:06.422525 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d492ec-7777-46ba-afe9-96ff0f39c992 admin admin] RBAC: Authorizing `identity:get_user(user_id=1e6cadb2f0fe422088a106e6a578b2f7)` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:06.424702 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d492ec-7777-46ba-afe9-96ff0f39c992 admin admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:06.426312 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 5/9] 10.222.0.66 () {56 vars in 1198 bytes} [Mon Jul 25 21:21:06 2022] GET /identity/v3/users/1e6cadb2f0fe422088a106e6a578b2f7 => generated 247 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:21:08.722760 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad80e2d-483d-4bf5-89eb-d38afdc35afd None None] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:08.723351 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad80e2d-483d-4bf5-89eb-d38afdc35afd None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:08.723351 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad80e2d-483d-4bf5-89eb-d38afdc35afd None None] PATH_INFO: `/` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:08.724635 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 5/10] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:21:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:21:08.730213 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac45ee6-4d01-48ab-b594-81ec5749432a None None] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:08.730655 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac45ee6-4d01-48ab-b594-81ec5749432a None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:08.730757 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac45ee6-4d01-48ab-b594-81ec5749432a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:08.741718 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaf26c8-56f6-4665-a992-49f0efcc1cb7 None None] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:08.741980 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaf26c8-56f6-4665-a992-49f0efcc1cb7 None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:08.742277 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaf26c8-56f6-4665-a992-49f0efcc1cb7 None None] PATH_INFO: `/` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:08.743596 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 6/11] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:21:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:21:08.748844 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cd84b2-9157-4dc8-9926-3345af5c3145 None None] REQUEST_METHOD: `POST` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:08.749157 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cd84b2-9157-4dc8-9926-3345af5c3145 None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:08.749436 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cd84b2-9157-4dc8-9926-3345af5c3145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:08.751140 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.auth.core [None req-6ac45ee6-4d01-48ab-b594-81ec5749432a None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:21:08.752393 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-6ac45ee6-4d01-48ab-b594-81ec5749432a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:21:08.793462 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG passlib.handlers.bcrypt [None req-57cd84b2-9157-4dc8-9926-3345af5c3145 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=87210) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 25 21:21:08.793857 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG passlib.handlers.bcrypt [None req-57cd84b2-9157-4dc8-9926-3345af5c3145 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=87210) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 25 21:21:08.836522 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 6/12] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:21:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:21:08.838941 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.auth.core [None req-57cd84b2-9157-4dc8-9926-3345af5c3145 None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:21:08.840554 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.fernet_utils [None req-57cd84b2-9157-4dc8-9926-3345af5c3145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:21:08.861492 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac45ee6-4d01-48ab-b594-81ec5749432a None None] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:08.885756 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:08.945616 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 7/13] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:21:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:21:08.968627 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cd84b2-9157-4dc8-9926-3345af5c3145 None None] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:08.972255 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac45ee6-4d01-48ab-b594-81ec5749432a None None] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:09.006479 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d586ffb-c982-4e7a-aef8-d4cd9fe5fcd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:09.007063 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d586ffb-c982-4e7a-aef8-d4cd9fe5fcd1 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:09.007341 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d586ffb-c982-4e7a-aef8-d4cd9fe5fcd1 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:09.007614 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d586ffb-c982-4e7a-aef8-d4cd9fe5fcd1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:09.019851 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d586ffb-c982-4e7a-aef8-d4cd9fe5fcd1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:21:09.028742 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application [None req-1d586ffb-c982-4e7a-aef8-d4cd9fe5fcd1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 21:21:09.028742 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:21:09.028742 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:21:09.028742 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:21:09.028742 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:21:09.028742 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:21:09.028742 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:21:09.028742 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:21:09.028742 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:21:09.028742 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:21:09.028742 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:21:09.028742 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:21:09.028742 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:21:09.028742 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:21:09.028742 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:21:09.028742 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:21:09.029696 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:21:09.029696 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:21:09.029696 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:21:09.029696 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:21:09.029696 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:21:09.029696 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:21:09.029696 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:21:09.029696 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:21:09.029696 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:21:09.029696 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:21:09.029696 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:21:09.029696 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application with Lock( Jul 25 21:21:09.029696 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:21:09.029696 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:21:09.029696 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:21:09.029696 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:21:09.030499 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:21:09.030499 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:21:09.030499 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:21:09.030499 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:21:09.030499 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:21:09.030499 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:21:09.030499 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:21:09.030499 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:21:09.030499 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:21:09.030499 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:21:09.030499 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 21:21:09.030499 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Jul 25 21:21:09.030499 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 7/14] 10.222.0.66 () {56 vars in 1096 bytes} [Mon Jul 25 21:21:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 21:21:09.036224 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d586ffb-c982-4e7a-aef8-d4cd9fe5fcd1 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:09.071221 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cd84b2-9157-4dc8-9926-3345af5c3145 None None] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:09.073669 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:09.110751 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b3bb17-1472-4f46-896e-90379c20a433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:09.111720 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b3bb17-1472-4f46-896e-90379c20a433 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:09.112076 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b3bb17-1472-4f46-896e-90379c20a433 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:09.112347 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b3bb17-1472-4f46-896e-90379c20a433 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:09.121037 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:09.141127 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d586ffb-c982-4e7a-aef8-d4cd9fe5fcd1 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:09.178587 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dee406-2fe5-40e6-89f5-7ddd31125c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:09.179388 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dee406-2fe5-40e6-89f5-7ddd31125c2d None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:09.179676 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dee406-2fe5-40e6-89f5-7ddd31125c2d None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:09.180429 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dee406-2fe5-40e6-89f5-7ddd31125c2d None admin] PATH_INFO: `/v3/roles` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:09.181195 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dee406-2fe5-40e6-89f5-7ddd31125c2d None admin] RBAC: Adding query filter params (name=admin) {{(pid=87209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:21:09.181510 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dee406-2fe5-40e6-89f5-7ddd31125c2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:09.182027 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b3bb17-1472-4f46-896e-90379c20a433 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:09.182921 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dee406-2fe5-40e6-89f5-7ddd31125c2d None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:09.183559 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b3bb17-1472-4f46-896e-90379c20a433 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:09.195555 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 8/15] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Jul 25 21:21:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:21:09.201543 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dee406-2fe5-40e6-89f5-7ddd31125c2d None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:09.286105 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 8/16] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Jul 25 21:21:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 25 21:21:09.292186 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b3bb17-1472-4f46-896e-90379c20a433 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:09.294970 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:09.306425 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dee406-2fe5-40e6-89f5-7ddd31125c2d None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:09.342888 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e271b5ab-73a4-4ca5-9d3d-bd7010fb4d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:09.344113 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e271b5ab-73a4-4ca5-9d3d-bd7010fb4d71 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:09.344661 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e271b5ab-73a4-4ca5-9d3d-bd7010fb4d71 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:09.345130 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e271b5ab-73a4-4ca5-9d3d-bd7010fb4d71 None admin] PATH_INFO: `/v3/users/1e6cadb2f0fe422088a106e6a578b2f7` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:09.347219 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e271b5ab-73a4-4ca5-9d3d-bd7010fb4d71 None admin] RBAC: Authorizing `identity:get_user(user_id=1e6cadb2f0fe422088a106e6a578b2f7)` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:09.350046 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e271b5ab-73a4-4ca5-9d3d-bd7010fb4d71 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:09.353284 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 9/17] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Jul 25 21:21:09 2022] GET /identity/v3/users/1e6cadb2f0fe422088a106e6a578b2f7 => generated 247 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:21:09.359093 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e271b5ab-73a4-4ca5-9d3d-bd7010fb4d71 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:09.374963 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:09.395576 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b3bb17-1472-4f46-896e-90379c20a433 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:09.430264 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a26b3b-60be-4b93-8392-61b09cdd6aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:09.431152 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a26b3b-60be-4b93-8392-61b09cdd6aa9 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:09.431446 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a26b3b-60be-4b93-8392-61b09cdd6aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:09.431709 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a26b3b-60be-4b93-8392-61b09cdd6aa9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:09.451567 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a26b3b-60be-4b93-8392-61b09cdd6aa9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:09.453034 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a26b3b-60be-4b93-8392-61b09cdd6aa9 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:09.462541 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e271b5ab-73a4-4ca5-9d3d-bd7010fb4d71 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:09.471275 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application [None req-02a26b3b-60be-4b93-8392-61b09cdd6aa9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:21:09.471275 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:21:09.471275 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:21:09.471275 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:21:09.471275 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:21:09.471275 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:21:09.471275 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:21:09.471275 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:21:09.471275 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:21:09.471275 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:21:09.471275 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:21:09.471275 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:21:09.471275 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:21:09.471275 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:21:09.471275 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:21:09.472120 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:21:09.472120 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:21:09.472120 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:21:09.472120 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:21:09.472120 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:21:09.472120 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:21:09.472120 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:21:09.472120 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:21:09.472120 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application with Lock( Jul 25 21:21:09.472120 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:21:09.472120 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:21:09.472120 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:21:09.472120 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:21:09.472120 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:21:09.472120 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:21:09.472120 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:21:09.472120 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:21:09.473131 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:21:09.473131 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:21:09.473131 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:21:09.473131 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Jul 25 21:21:09.473131 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 9/18] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 25 21:21:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 21:21:09.479206 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a26b3b-60be-4b93-8392-61b09cdd6aa9 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:09.498463 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948e5288-6822-42ff-a7c1-e4c9e9734cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:09.499133 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948e5288-6822-42ff-a7c1-e4c9e9734cca None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:09.499434 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948e5288-6822-42ff-a7c1-e4c9e9734cca None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:09.499706 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948e5288-6822-42ff-a7c1-e4c9e9734cca None admin] PATH_INFO: `/v3/domains/default` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:09.500987 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948e5288-6822-42ff-a7c1-e4c9e9734cca None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:09.502562 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948e5288-6822-42ff-a7c1-e4c9e9734cca None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:09.504161 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 10/19] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 25 21:21:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:21:09.510245 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948e5288-6822-42ff-a7c1-e4c9e9734cca None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:09.537988 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:09.583814 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a26b3b-60be-4b93-8392-61b09cdd6aa9 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:09.593611 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:09.613865 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948e5288-6822-42ff-a7c1-e4c9e9734cca None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:09.618197 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89b26a4-6382-4fb3-8d64-41db5ea3b83c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:09.618824 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89b26a4-6382-4fb3-8d64-41db5ea3b83c None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:09.619104 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89b26a4-6382-4fb3-8d64-41db5ea3b83c None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:09.619375 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89b26a4-6382-4fb3-8d64-41db5ea3b83c None admin] PATH_INFO: `/v3/domains` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:09.620070 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89b26a4-6382-4fb3-8d64-41db5ea3b83c None admin] RBAC: Adding query filter params (name=Default) {{(pid=87210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:21:09.620370 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89b26a4-6382-4fb3-8d64-41db5ea3b83c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:09.621824 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89b26a4-6382-4fb3-8d64-41db5ea3b83c None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:09.639133 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 10/20] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Jul 25 21:21:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:21:09.648110 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc8e114-f62f-43aa-8aae-c50bb4774905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:09.648763 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc8e114-f62f-43aa-8aae-c50bb4774905 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:09.649046 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc8e114-f62f-43aa-8aae-c50bb4774905 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:09.649354 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc8e114-f62f-43aa-8aae-c50bb4774905 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:09.650158 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc8e114-f62f-43aa-8aae-c50bb4774905 None admin] RBAC: Adding query filter params (role.id=216a86497a3a4593ba08730ea8697df3, scope.domain.id=default, user.id=1e6cadb2f0fe422088a106e6a578b2f7) {{(pid=87209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:21:09.650465 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc8e114-f62f-43aa-8aae-c50bb4774905 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:09.651977 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc8e114-f62f-43aa-8aae-c50bb4774905 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:09.659908 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 11/21] 10.222.0.66 () {56 vars in 1322 bytes} [Mon Jul 25 21:21:09 2022] GET /identity/v3/role_assignments?user.id=1e6cadb2f0fe422088a106e6a578b2f7&scope.domain.id=default&role.id=216a86497a3a4593ba08730ea8697df3 => generated 233 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:21:12.421178 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3e1f2a-6ec7-45ed-af13-739e7cb41837 None None] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:12.421698 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3e1f2a-6ec7-45ed-af13-739e7cb41837 None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:12.421698 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3e1f2a-6ec7-45ed-af13-739e7cb41837 None None] PATH_INFO: `/` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:12.423086 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 11/22] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:21:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:21:12.434784 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d99f073-ed49-4ac0-8a55-43e388d7be4c None None] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:12.435278 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d99f073-ed49-4ac0-8a55-43e388d7be4c None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:12.435361 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d99f073-ed49-4ac0-8a55-43e388d7be4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:12.466435 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.auth.core [None req-1d99f073-ed49-4ac0-8a55-43e388d7be4c None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:21:12.467687 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-1d99f073-ed49-4ac0-8a55-43e388d7be4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:21:12.513801 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09406f4c-b73c-42c1-8a0b-ddb05f9e5bd5 None None] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:12.514129 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09406f4c-b73c-42c1-8a0b-ddb05f9e5bd5 None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:12.514351 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09406f4c-b73c-42c1-8a0b-ddb05f9e5bd5 None None] PATH_INFO: `/` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:12.515985 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 12/23] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:21:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:21:12.520642 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6093cf71-a9f9-43b8-98b6-84ed351c7ffa None None] REQUEST_METHOD: `POST` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:12.520922 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6093cf71-a9f9-43b8-98b6-84ed351c7ffa None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:12.521225 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6093cf71-a9f9-43b8-98b6-84ed351c7ffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:12.558397 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.auth.core [None req-6093cf71-a9f9-43b8-98b6-84ed351c7ffa None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:21:12.559664 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.fernet_utils [None req-6093cf71-a9f9-43b8-98b6-84ed351c7ffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:21:12.603090 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 12/24] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:21:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:21:12.644627 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d99f073-ed49-4ac0-8a55-43e388d7be4c None None] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:12.713941 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 13/25] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:21:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 21:21:12.715327 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39f3820-3942-47f5-897a-d682c9ee36eb None None] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:12.715617 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39f3820-3942-47f5-897a-d682c9ee36eb None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:12.715891 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39f3820-3942-47f5-897a-d682c9ee36eb None None] PATH_INFO: `/` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:12.717168 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 14/26] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:21:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:21:12.723969 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934ddf81-401d-40b2-b48a-c74c42638019 None None] REQUEST_METHOD: `POST` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:12.724255 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934ddf81-401d-40b2-b48a-c74c42638019 None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:12.724519 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934ddf81-401d-40b2-b48a-c74c42638019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:12.756166 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.auth.core [None req-934ddf81-401d-40b2-b48a-c74c42638019 None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:21:12.757409 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.fernet_utils [None req-934ddf81-401d-40b2-b48a-c74c42638019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:21:12.786321 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:12.810206 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:12.813628 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d99f073-ed49-4ac0-8a55-43e388d7be4c None None] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:12.838604 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 15/27] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:21:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:21:12.839833 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934ddf81-401d-40b2-b48a-c74c42638019 None None] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:12.850463 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4940c4-58b7-4a9c-94ba-3dd634ac776a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:12.851448 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4940c4-58b7-4a9c-94ba-3dd634ac776a None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:12.851933 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4940c4-58b7-4a9c-94ba-3dd634ac776a None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:12.852505 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4940c4-58b7-4a9c-94ba-3dd634ac776a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:12.868246 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4940c4-58b7-4a9c-94ba-3dd634ac776a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:12.870199 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4940c4-58b7-4a9c-94ba-3dd634ac776a None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:12.887103 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application [None req-4a4940c4-58b7-4a9c-94ba-3dd634ac776a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:21:12.887103 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:21:12.887103 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:21:12.887103 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:21:12.887103 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:21:12.887103 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:21:12.887103 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:21:12.887103 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:21:12.887103 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:21:12.887103 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:21:12.887103 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:21:12.887103 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:21:12.887103 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:21:12.887103 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:21:12.887103 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:21:12.887969 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:21:12.887969 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:21:12.887969 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:21:12.887969 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:21:12.887969 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:21:12.887969 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:21:12.887969 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:21:12.887969 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:21:12.887969 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application with Lock( Jul 25 21:21:12.887969 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:21:12.887969 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:21:12.887969 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:21:12.887969 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:21:12.887969 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:21:12.887969 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:21:12.887969 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:21:12.887969 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:21:12.888778 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:21:12.888778 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:21:12.888778 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:21:12.888778 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Jul 25 21:21:12.890724 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 13/28] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 25 21:21:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:21:12.892250 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5d2fb3-2636-46e5-8dd0-5f9423dd8247 None None] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:12.892761 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5d2fb3-2636-46e5-8dd0-5f9423dd8247 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:12.893260 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5d2fb3-2636-46e5-8dd0-5f9423dd8247 None None] PATH_INFO: `/` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:12.895193 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 14/29] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:21:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:21:12.896093 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5d2fb3-2636-46e5-8dd0-5f9423dd8247 None None] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:12.948923 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934ddf81-401d-40b2-b48a-c74c42638019 None None] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:12.985594 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e54049-200a-4a1d-a561-d54ec38b9ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:12.986118 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e54049-200a-4a1d-a561-d54ec38b9ee7 None admin] REQUEST_METHOD: `POST` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:12.986818 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e54049-200a-4a1d-a561-d54ec38b9ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:12.987547 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e54049-200a-4a1d-a561-d54ec38b9ee7 None admin] PATH_INFO: `/v3/roles` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:12.989033 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e54049-200a-4a1d-a561-d54ec38b9ee7 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:12.991530 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e54049-200a-4a1d-a561-d54ec38b9ee7 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:13.026333 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5d2fb3-2636-46e5-8dd0-5f9423dd8247 None None] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:13.054226 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:13.064645 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51122f33-7e28-43f7-a86d-ef2f89cb6cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:13.065917 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51122f33-7e28-43f7-a86d-ef2f89cb6cc3 None admin] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:13.066294 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51122f33-7e28-43f7-a86d-ef2f89cb6cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:13.066658 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51122f33-7e28-43f7-a86d-ef2f89cb6cc3 None admin] PATH_INFO: `/v3/roles` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:13.067721 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51122f33-7e28-43f7-a86d-ef2f89cb6cc3 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:13.069583 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51122f33-7e28-43f7-a86d-ef2f89cb6cc3 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:13.129521 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 16/30] 10.222.0.66 () {60 vars in 1131 bytes} [Mon Jul 25 21:21:12 2022] POST /identity/v3/roles => generated 219 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 21:21:13.136060 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e54049-200a-4a1d-a561-d54ec38b9ee7 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:13.209102 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:13.218409 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 15/31] 10.222.0.66 () {60 vars in 1131 bytes} [Mon Jul 25 21:21:12 2022] POST /identity/v3/roles => generated 225 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 21:21:13.218409 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17322c1-afc3-4f1b-997c-a36aede62407 None None] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:13.218409 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17322c1-afc3-4f1b-997c-a36aede62407 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:13.218702 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17322c1-afc3-4f1b-997c-a36aede62407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:13.242859 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.auth.core [None req-d17322c1-afc3-4f1b-997c-a36aede62407 None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:21:13.244297 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-d17322c1-afc3-4f1b-997c-a36aede62407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:21:13.319210 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e54049-200a-4a1d-a561-d54ec38b9ee7 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:13.335217 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 16/32] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:21:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:21:13.357471 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fe7722-977b-4708-8e73-3e361a9ff085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:13.358539 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fe7722-977b-4708-8e73-3e361a9ff085 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:13.359027 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fe7722-977b-4708-8e73-3e361a9ff085 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:13.359493 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fe7722-977b-4708-8e73-3e361a9ff085 None admin] PATH_INFO: `/v3/domains` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:13.360422 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17322c1-afc3-4f1b-997c-a36aede62407 None None] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:13.360549 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fe7722-977b-4708-8e73-3e361a9ff085 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:21:13.361047 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fe7722-977b-4708-8e73-3e361a9ff085 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:13.364061 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fe7722-977b-4708-8e73-3e361a9ff085 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:13.381066 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 17/33] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Jul 25 21:21:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:21:13.390203 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fe7722-977b-4708-8e73-3e361a9ff085 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:13.492515 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17322c1-afc3-4f1b-997c-a36aede62407 None None] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:13.514950 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:13.541211 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1102700-7618-4d79-934d-1f87c78ff686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:13.541961 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1102700-7618-4d79-934d-1f87c78ff686 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:13.542246 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1102700-7618-4d79-934d-1f87c78ff686 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:13.542524 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1102700-7618-4d79-934d-1f87c78ff686 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:13.557670 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:13.558174 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1102700-7618-4d79-934d-1f87c78ff686 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:21:13.562933 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application [None req-d1102700-7618-4d79-934d-1f87c78ff686 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 21:21:13.562933 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:21:13.562933 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:21:13.562933 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:21:13.562933 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:21:13.562933 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:21:13.562933 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:21:13.562933 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:21:13.562933 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:21:13.562933 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:21:13.562933 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:21:13.562933 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:21:13.562933 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:21:13.562933 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:21:13.562933 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:21:13.562933 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:21:13.563806 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:21:13.563806 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:21:13.563806 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:21:13.563806 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:21:13.563806 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:21:13.563806 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:21:13.563806 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:21:13.563806 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:21:13.563806 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:21:13.563806 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:21:13.563806 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:21:13.563806 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application with Lock( Jul 25 21:21:13.563806 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:21:13.563806 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:21:13.563806 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:21:13.563806 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:21:13.564831 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:21:13.564831 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:21:13.564831 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:21:13.564831 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:21:13.564831 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:21:13.564831 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:21:13.564831 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:21:13.564831 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:21:13.564831 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:21:13.564831 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:21:13.564831 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 21:21:13.564831 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Jul 25 21:21:13.564831 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 17/34] 10.222.0.66 () {56 vars in 1096 bytes} [Mon Jul 25 21:21:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:21:13.575953 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fe7722-977b-4708-8e73-3e361a9ff085 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:13.578809 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1102700-7618-4d79-934d-1f87c78ff686 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:13.623944 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15314ac0-0cbd-4f9a-ad8c-0c20b191554f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:13.625017 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15314ac0-0cbd-4f9a-ad8c-0c20b191554f None admin] REQUEST_METHOD: `POST` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:13.625480 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15314ac0-0cbd-4f9a-ad8c-0c20b191554f None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:13.625891 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15314ac0-0cbd-4f9a-ad8c-0c20b191554f None admin] PATH_INFO: `/v3/projects` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:13.627224 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15314ac0-0cbd-4f9a-ad8c-0c20b191554f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:13.629683 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15314ac0-0cbd-4f9a-ad8c-0c20b191554f None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:13.674740 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 18/35] 10.222.0.66 () {60 vars in 1141 bytes} [Mon Jul 25 21:21:13 2022] POST /identity/v3/projects => generated 301 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 21:21:13.709844 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1102700-7618-4d79-934d-1f87c78ff686 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:13.751702 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a02b70-7be3-4f3b-94a1-ceb63892747f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:13.752447 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a02b70-7be3-4f3b-94a1-ceb63892747f None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:13.752732 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a02b70-7be3-4f3b-94a1-ceb63892747f None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:13.753008 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a02b70-7be3-4f3b-94a1-ceb63892747f None admin] PATH_INFO: `/v3/roles` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:13.753791 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a02b70-7be3-4f3b-94a1-ceb63892747f None admin] RBAC: Adding query filter params (name=admin) {{(pid=87209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:21:13.754099 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a02b70-7be3-4f3b-94a1-ceb63892747f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:13.755904 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a02b70-7be3-4f3b-94a1-ceb63892747f None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:13.766119 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 18/36] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Jul 25 21:21:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:21:13.772328 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15314ac0-0cbd-4f9a-ad8c-0c20b191554f None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:13.892508 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15314ac0-0cbd-4f9a-ad8c-0c20b191554f None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:13.928919 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6126a930-9971-4d4e-a944-15bd1af2db9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:13.929626 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6126a930-9971-4d4e-a944-15bd1af2db9c None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:13.929907 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6126a930-9971-4d4e-a944-15bd1af2db9c None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:13.930183 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6126a930-9971-4d4e-a944-15bd1af2db9c None admin] PATH_INFO: `/v3/users/1e6cadb2f0fe422088a106e6a578b2f7` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:13.931649 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6126a930-9971-4d4e-a944-15bd1af2db9c None admin] RBAC: Authorizing `identity:get_user(user_id=1e6cadb2f0fe422088a106e6a578b2f7)` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:13.933157 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6126a930-9971-4d4e-a944-15bd1af2db9c None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:13.935167 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 19/37] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Jul 25 21:21:13 2022] GET /identity/v3/users/1e6cadb2f0fe422088a106e6a578b2f7 => generated 247 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:21:13.941172 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a02b70-7be3-4f3b-94a1-ceb63892747f None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:13.991599 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:13.996260 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4f2ebc-5155-4c1a-8bcb-54307c30155d None None] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:13.996579 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4f2ebc-5155-4c1a-8bcb-54307c30155d None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:13.996931 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4f2ebc-5155-4c1a-8bcb-54307c30155d None None] PATH_INFO: `/` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:13.998492 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 20/38] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:21:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 21:21:14.005030 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615b06c2-7cb0-4f8d-a825-ee1d5c2c67ff None None] REQUEST_METHOD: `POST` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:14.005634 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615b06c2-7cb0-4f8d-a825-ee1d5c2c67ff None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:14.005921 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615b06c2-7cb0-4f8d-a825-ee1d5c2c67ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:14.026966 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.auth.core [None req-615b06c2-7cb0-4f8d-a825-ee1d5c2c67ff None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:21:14.028519 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.fernet_utils [None req-615b06c2-7cb0-4f8d-a825-ee1d5c2c67ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:21:14.049117 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:14.067063 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a02b70-7be3-4f3b-94a1-ceb63892747f None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:14.102775 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94147e7e-871c-4431-9ef1-2f38544f34e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:14.103441 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94147e7e-871c-4431-9ef1-2f38544f34e3 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:14.103729 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94147e7e-871c-4431-9ef1-2f38544f34e3 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:14.104006 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94147e7e-871c-4431-9ef1-2f38544f34e3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:14.105209 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94147e7e-871c-4431-9ef1-2f38544f34e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:14.106728 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94147e7e-871c-4431-9ef1-2f38544f34e3 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:14.108615 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 19/39] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 25 21:21:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:21:14.110357 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 21/40] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:21:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:21:14.117759 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94147e7e-871c-4431-9ef1-2f38544f34e3 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:14.139253 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615b06c2-7cb0-4f8d-a825-ee1d5c2c67ff None None] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:14.219894 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94147e7e-871c-4431-9ef1-2f38544f34e3 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:14.226823 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:14.243512 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615b06c2-7cb0-4f8d-a825-ee1d5c2c67ff None None] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:14.255513 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf73f33-4503-4ac8-943b-ad79b46fc84d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:14.256168 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf73f33-4503-4ac8-943b-ad79b46fc84d None admin] REQUEST_METHOD: `PUT` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:14.256476 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf73f33-4503-4ac8-943b-ad79b46fc84d None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:14.256769 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf73f33-4503-4ac8-943b-ad79b46fc84d None admin] PATH_INFO: `/v3/domains/default/users/1e6cadb2f0fe422088a106e6a578b2f7/roles/216a86497a3a4593ba08730ea8697df3` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:14.258797 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf73f33-4503-4ac8-943b-ad79b46fc84d None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=1e6cadb2f0fe422088a106e6a578b2f7, role_id=216a86497a3a4593ba08730ea8697df3)` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:14.260280 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf73f33-4503-4ac8-943b-ad79b46fc84d None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:14.276156 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 20/41] 10.222.0.66 () {58 vars in 1361 bytes} [Mon Jul 25 21:21:14 2022] PUT /identity/v3/domains/default/users/1e6cadb2f0fe422088a106e6a578b2f7/roles/216a86497a3a4593ba08730ea8697df3 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 21:21:14.285462 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b192037-b391-46b8-b536-b792fb937227 None None] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:14.285462 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b192037-b391-46b8-b536-b792fb937227 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:14.285462 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b192037-b391-46b8-b536-b792fb937227 None None] PATH_INFO: `/` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:14.285462 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 21/42] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:21:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:21:14.285727 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac67139-f31e-475a-9e77-06126615bf7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:14.285727 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac67139-f31e-475a-9e77-06126615bf7e None admin] REQUEST_METHOD: `POST` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:14.285727 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac67139-f31e-475a-9e77-06126615bf7e None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:14.285727 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac67139-f31e-475a-9e77-06126615bf7e None admin] PATH_INFO: `/v3/roles` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:14.285992 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac67139-f31e-475a-9e77-06126615bf7e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:14.285992 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac67139-f31e-475a-9e77-06126615bf7e None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:14.286144 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd41879-9d77-4683-8760-5685fbceffd4 None None] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:14.286144 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd41879-9d77-4683-8760-5685fbceffd4 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:14.286144 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd41879-9d77-4683-8760-5685fbceffd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:14.307214 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.auth.core [None req-dbd41879-9d77-4683-8760-5685fbceffd4 None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:21:14.321427 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 22/43] 10.222.0.66 () {60 vars in 1131 bytes} [Mon Jul 25 21:21:14 2022] POST /identity/v3/roles => generated 223 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 21:21:14.321633 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-dbd41879-9d77-4683-8760-5685fbceffd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:21:14.394628 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 22/44] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:21:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 21:21:14.419968 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac67139-f31e-475a-9e77-06126615bf7e None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:14.431093 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:14.545993 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac67139-f31e-475a-9e77-06126615bf7e None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:14.581904 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a5431d-35d5-490d-89a5-026aefafb912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:14.582565 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a5431d-35d5-490d-89a5-026aefafb912 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:14.582843 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a5431d-35d5-490d-89a5-026aefafb912 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:14.583114 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a5431d-35d5-490d-89a5-026aefafb912 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:14.584271 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a5431d-35d5-490d-89a5-026aefafb912 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:14.585804 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a5431d-35d5-490d-89a5-026aefafb912 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:14.587409 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 23/45] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 25 21:21:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:21:14.593047 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd41879-9d77-4683-8760-5685fbceffd4 None None] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:14.688906 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:14.696211 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd41879-9d77-4683-8760-5685fbceffd4 None None] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:14.733488 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f4f537-caf6-47ab-8f1c-251e089eef34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:14.734139 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f4f537-caf6-47ab-8f1c-251e089eef34 None admin] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:14.734417 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f4f537-caf6-47ab-8f1c-251e089eef34 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:14.734695 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f4f537-caf6-47ab-8f1c-251e089eef34 None admin] PATH_INFO: `/v3/projects` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:14.735376 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f4f537-caf6-47ab-8f1c-251e089eef34 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:14.737103 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f4f537-caf6-47ab-8f1c-251e089eef34 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:14.768469 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 23/46] 10.222.0.66 () {60 vars in 1141 bytes} [Mon Jul 25 21:21:14 2022] POST /identity/v3/projects => generated 312 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 21:21:16.532438 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc31014-f16b-4251-8711-0dfa38080db6 None None] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:16.532984 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc31014-f16b-4251-8711-0dfa38080db6 None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:16.532984 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc31014-f16b-4251-8711-0dfa38080db6 None None] PATH_INFO: `/` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:16.534489 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 24/47] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:21:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:21:16.539764 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6df9ca4-dc6a-40d2-889c-47d1357fb870 None None] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:16.540559 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6df9ca4-dc6a-40d2-889c-47d1357fb870 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:16.540647 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6df9ca4-dc6a-40d2-889c-47d1357fb870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:16.560032 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.auth.core [None req-b6df9ca4-dc6a-40d2-889c-47d1357fb870 None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:21:16.561285 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-b6df9ca4-dc6a-40d2-889c-47d1357fb870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:21:16.632664 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 24/48] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:21:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:21:16.657049 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc31014-f16b-4251-8711-0dfa38080db6 None None] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:16.740351 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:16.767187 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc31014-f16b-4251-8711-0dfa38080db6 None None] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:16.802788 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4116c102-7d39-4332-8320-98e44e3bef18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:16.803386 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4116c102-7d39-4332-8320-98e44e3bef18 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:16.803672 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4116c102-7d39-4332-8320-98e44e3bef18 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:16.803947 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4116c102-7d39-4332-8320-98e44e3bef18 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:16.816760 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4116c102-7d39-4332-8320-98e44e3bef18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:21:16.823053 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application [None req-4116c102-7d39-4332-8320-98e44e3bef18 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 21:21:16.823053 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:21:16.823053 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:21:16.823053 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:21:16.823053 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:21:16.823053 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:21:16.823053 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:21:16.823053 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:21:16.823053 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:21:16.823053 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:21:16.823053 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:21:16.823053 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:21:16.823053 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:21:16.823053 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:21:16.823053 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:21:16.823053 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:21:16.823949 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:21:16.823949 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:21:16.823949 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:21:16.823949 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:21:16.823949 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:21:16.823949 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:21:16.823949 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:21:16.823949 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:21:16.823949 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:21:16.823949 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:21:16.823949 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:21:16.823949 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application with Lock( Jul 25 21:21:16.823949 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:21:16.823949 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:21:16.823949 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:21:16.823949 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:21:16.824702 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:21:16.824702 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:21:16.824702 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:21:16.824702 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:21:16.824702 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:21:16.824702 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:21:16.824702 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:21:16.824702 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:21:16.824702 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:21:16.824702 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:21:16.824702 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 21:21:16.824702 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Jul 25 21:21:16.824702 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 25/49] 10.222.0.66 () {56 vars in 1096 bytes} [Mon Jul 25 21:21:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:21:16.830565 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6df9ca4-dc6a-40d2-889c-47d1357fb870 None None] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:16.920250 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:16.942863 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6df9ca4-dc6a-40d2-889c-47d1357fb870 None None] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:16.981775 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3fc17c-7205-4c46-8c2a-28808d48083f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:16.982409 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3fc17c-7205-4c46-8c2a-28808d48083f None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:16.982694 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3fc17c-7205-4c46-8c2a-28808d48083f None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:16.982979 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3fc17c-7205-4c46-8c2a-28808d48083f None admin] PATH_INFO: `/v3/roles` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:16.983696 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3fc17c-7205-4c46-8c2a-28808d48083f None admin] RBAC: Adding query filter params (name=admin) {{(pid=87209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:21:16.984003 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3fc17c-7205-4c46-8c2a-28808d48083f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:16.985444 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3fc17c-7205-4c46-8c2a-28808d48083f None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:16.994169 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 25/50] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Jul 25 21:21:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:21:17.000018 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4116c102-7d39-4332-8320-98e44e3bef18 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:17.003210 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c96b5d7-df91-4182-ba5e-4588fae69ddc None None] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:17.003501 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c96b5d7-df91-4182-ba5e-4588fae69ddc None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:17.003784 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c96b5d7-df91-4182-ba5e-4588fae69ddc None None] PATH_INFO: `/` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:17.005131 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 26/51] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:21:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 21:21:17.010191 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c741143e-280d-403f-a573-61fb5eb54051 None None] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:17.010484 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c741143e-280d-403f-a573-61fb5eb54051 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:17.010764 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c741143e-280d-403f-a573-61fb5eb54051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:17.028729 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.auth.core [None req-c741143e-280d-403f-a573-61fb5eb54051 None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:21:17.030052 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-c741143e-280d-403f-a573-61fb5eb54051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:21:17.100633 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 27/52] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:21:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:21:17.103374 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4116c102-7d39-4332-8320-98e44e3bef18 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:17.125311 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c741143e-280d-403f-a573-61fb5eb54051 None None] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:17.137636 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990264cc-4c76-4339-b4a4-cfe8e10f8805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:17.138346 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990264cc-4c76-4339-b4a4-cfe8e10f8805 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:17.138637 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990264cc-4c76-4339-b4a4-cfe8e10f8805 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:17.138915 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990264cc-4c76-4339-b4a4-cfe8e10f8805 None admin] PATH_INFO: `/v3/users/1e6cadb2f0fe422088a106e6a578b2f7` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:17.140152 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990264cc-4c76-4339-b4a4-cfe8e10f8805 None admin] RBAC: Authorizing `identity:get_user(user_id=1e6cadb2f0fe422088a106e6a578b2f7)` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:17.141733 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990264cc-4c76-4339-b4a4-cfe8e10f8805 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:17.143458 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 26/53] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Jul 25 21:21:16 2022] GET /identity/v3/users/1e6cadb2f0fe422088a106e6a578b2f7 => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:21:17.148918 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990264cc-4c76-4339-b4a4-cfe8e10f8805 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:17.151632 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:17.195774 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:17.227625 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c741143e-280d-403f-a573-61fb5eb54051 None None] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:17.252883 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990264cc-4c76-4339-b4a4-cfe8e10f8805 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:17.261212 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3372cf7d-3c7f-4110-be6d-bfeadd814106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:17.261878 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3372cf7d-3c7f-4110-be6d-bfeadd814106 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:17.262155 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3372cf7d-3c7f-4110-be6d-bfeadd814106 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:17.262423 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3372cf7d-3c7f-4110-be6d-bfeadd814106 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:17.263586 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3372cf7d-3c7f-4110-be6d-bfeadd814106 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:17.265048 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3372cf7d-3c7f-4110-be6d-bfeadd814106 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:17.266660 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 28/54] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 25 21:21:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:21:17.272229 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3372cf7d-3c7f-4110-be6d-bfeadd814106 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:17.286769 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d03afc-e094-4056-8573-05b1fa4075f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:17.287429 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d03afc-e094-4056-8573-05b1fa4075f9 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:17.287713 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d03afc-e094-4056-8573-05b1fa4075f9 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:17.287991 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d03afc-e094-4056-8573-05b1fa4075f9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:17.289207 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d03afc-e094-4056-8573-05b1fa4075f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:17.291015 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d03afc-e094-4056-8573-05b1fa4075f9 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:17.292616 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 27/55] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 25 21:21:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:21:17.298277 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d03afc-e094-4056-8573-05b1fa4075f9 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:17.367675 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:17.371798 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3372cf7d-3c7f-4110-be6d-bfeadd814106 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:17.400015 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d03afc-e094-4056-8573-05b1fa4075f9 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:17.414128 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e0baee-eb2f-4f54-bd22-e035a01b3917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:17.414774 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e0baee-eb2f-4f54-bd22-e035a01b3917 None admin] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:17.415388 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e0baee-eb2f-4f54-bd22-e035a01b3917 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:17.415681 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e0baee-eb2f-4f54-bd22-e035a01b3917 None admin] PATH_INFO: `/v3/projects` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:17.416363 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e0baee-eb2f-4f54-bd22-e035a01b3917 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:17.417868 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e0baee-eb2f-4f54-bd22-e035a01b3917 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:17.428199 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:17.437297 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e60902-5ee6-4564-8c01-f309a18d4ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:17.438002 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e60902-5ee6-4564-8c01-f309a18d4ae5 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:17.438226 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e60902-5ee6-4564-8c01-f309a18d4ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:17.438499 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e60902-5ee6-4564-8c01-f309a18d4ae5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:17.439457 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e60902-5ee6-4564-8c01-f309a18d4ae5 None admin] RBAC: Adding query filter params (role.id=216a86497a3a4593ba08730ea8697df3, scope.domain.id=default, user.id=1e6cadb2f0fe422088a106e6a578b2f7) {{(pid=87210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:21:17.439860 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e60902-5ee6-4564-8c01-f309a18d4ae5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:17.441477 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e60902-5ee6-4564-8c01-f309a18d4ae5 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:17.447138 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 29/56] 10.222.0.66 () {60 vars in 1140 bytes} [Mon Jul 25 21:21:17 2022] POST /identity/v3/projects => generated 298 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 21:21:17.450171 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 28/57] 10.222.0.66 () {56 vars in 1322 bytes} [Mon Jul 25 21:21:17 2022] GET /identity/v3/role_assignments?user.id=1e6cadb2f0fe422088a106e6a578b2f7&scope.domain.id=default&role.id=216a86497a3a4593ba08730ea8697df3 => generated 530 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:21:19.708898 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863fa557-aab8-42d1-b6d5-dd923c4afd7f None None] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:19.709488 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863fa557-aab8-42d1-b6d5-dd923c4afd7f None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:19.709488 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863fa557-aab8-42d1-b6d5-dd923c4afd7f None None] PATH_INFO: `/` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:19.710896 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 30/58] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:21:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:21:19.717385 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddebb91e-e2ac-4ad6-b2ba-cdeb0c3d8810 None None] REQUEST_METHOD: `POST` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:19.718142 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddebb91e-e2ac-4ad6-b2ba-cdeb0c3d8810 None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:19.718263 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddebb91e-e2ac-4ad6-b2ba-cdeb0c3d8810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:19.746770 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.auth.core [None req-ddebb91e-e2ac-4ad6-b2ba-cdeb0c3d8810 None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:21:19.748673 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.fernet_utils [None req-ddebb91e-e2ac-4ad6-b2ba-cdeb0c3d8810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:21:19.832700 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 29/59] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:21:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:21:19.869668 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863fa557-aab8-42d1-b6d5-dd923c4afd7f None None] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:19.985906 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863fa557-aab8-42d1-b6d5-dd923c4afd7f None None] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:20.021314 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de090834-d69f-4eae-9ba3-843129b53923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:20.021961 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de090834-d69f-4eae-9ba3-843129b53923 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:20.022243 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de090834-d69f-4eae-9ba3-843129b53923 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:20.022514 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de090834-d69f-4eae-9ba3-843129b53923 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:20.023723 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de090834-d69f-4eae-9ba3-843129b53923 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:20.025225 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de090834-d69f-4eae-9ba3-843129b53923 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:20.026810 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 31/60] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 25 21:21:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:21:20.032665 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddebb91e-e2ac-4ad6-b2ba-cdeb0c3d8810 None None] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:20.100458 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:20.137971 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddebb91e-e2ac-4ad6-b2ba-cdeb0c3d8810 None None] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:20.173268 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19232f02-b01e-4ae7-914e-141e7a7026fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:20.173933 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19232f02-b01e-4ae7-914e-141e7a7026fe None admin] REQUEST_METHOD: `POST` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:20.174205 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19232f02-b01e-4ae7-914e-141e7a7026fe None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:20.174452 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19232f02-b01e-4ae7-914e-141e7a7026fe None admin] PATH_INFO: `/v3/users` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:20.175160 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19232f02-b01e-4ae7-914e-141e7a7026fe None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:20.176632 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19232f02-b01e-4ae7-914e-141e7a7026fe None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:20.210039 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 30/61] 10.222.0.66 () {60 vars in 1132 bytes} [Mon Jul 25 21:21:20 2022] POST /identity/v3/users => generated 275 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 21:21:23.733469 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0dba20-d492-4f9c-9572-17c699b04aa3 None None] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:23.733994 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0dba20-d492-4f9c-9572-17c699b04aa3 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:23.734068 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0dba20-d492-4f9c-9572-17c699b04aa3 None None] PATH_INFO: `/` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:23.735413 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 32/62] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:21:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:21:23.740906 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1fc548-69ed-4ca3-8b99-e1f38aaee6a4 None None] REQUEST_METHOD: `POST` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:23.741353 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1fc548-69ed-4ca3-8b99-e1f38aaee6a4 None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:23.741478 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1fc548-69ed-4ca3-8b99-e1f38aaee6a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:23.768346 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.auth.core [None req-ac1fc548-69ed-4ca3-8b99-e1f38aaee6a4 None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:21:23.769921 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.fernet_utils [None req-ac1fc548-69ed-4ca3-8b99-e1f38aaee6a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:21:23.831380 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbd15f6-650d-447e-b0f9-368eb793d3bd None None] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:23.832013 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbd15f6-650d-447e-b0f9-368eb793d3bd None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:23.832486 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbd15f6-650d-447e-b0f9-368eb793d3bd None None] PATH_INFO: `/` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:23.834135 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 33/63] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:21:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:21:23.839365 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2214f33-b8b9-4c20-b8ec-f50586de4448 None None] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:23.839901 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2214f33-b8b9-4c20-b8ec-f50586de4448 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:23.840372 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2214f33-b8b9-4c20-b8ec-f50586de4448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:23.860133 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 31/64] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:21:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:21:23.870640 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.auth.core [None req-e2214f33-b8b9-4c20-b8ec-f50586de4448 None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:21:23.871892 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-e2214f33-b8b9-4c20-b8ec-f50586de4448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:21:23.896188 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1fc548-69ed-4ca3-8b99-e1f38aaee6a4 None None] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:23.960431 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:24.000339 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 34/65] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:21:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:21:24.001406 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:24.008121 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832b9bcf-fe39-45da-9510-75df6664f1a1 None None] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:24.008414 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832b9bcf-fe39-45da-9510-75df6664f1a1 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:24.008688 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832b9bcf-fe39-45da-9510-75df6664f1a1 None None] PATH_INFO: `/` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:24.013362 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 35/66] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:21:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:21:24.021439 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026d73cb-81d6-407b-80a7-8008c39dd0ad None None] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:24.021725 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026d73cb-81d6-407b-80a7-8008c39dd0ad None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:24.022005 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026d73cb-81d6-407b-80a7-8008c39dd0ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:24.048604 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.auth.core [None req-026d73cb-81d6-407b-80a7-8008c39dd0ad None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:21:24.054832 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-026d73cb-81d6-407b-80a7-8008c39dd0ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:21:24.066220 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1fc548-69ed-4ca3-8b99-e1f38aaee6a4 None None] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:24.102654 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401f34ee-58db-4352-a7a4-f0e687323666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:24.103317 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401f34ee-58db-4352-a7a4-f0e687323666 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:24.103596 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401f34ee-58db-4352-a7a4-f0e687323666 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:24.104029 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401f34ee-58db-4352-a7a4-f0e687323666 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:24.115553 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401f34ee-58db-4352-a7a4-f0e687323666 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:21:24.120793 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application [None req-401f34ee-58db-4352-a7a4-f0e687323666 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 21:21:24.120793 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:21:24.120793 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:21:24.120793 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:21:24.120793 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:21:24.120793 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:21:24.120793 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:21:24.120793 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:21:24.120793 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:21:24.120793 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:21:24.120793 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:21:24.120793 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:21:24.120793 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:21:24.120793 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:21:24.120793 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:21:24.120793 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:21:24.121680 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:21:24.121680 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:21:24.121680 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:21:24.121680 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:21:24.121680 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:21:24.121680 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:21:24.121680 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:21:24.121680 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:21:24.121680 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:21:24.121680 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:21:24.121680 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:21:24.121680 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application with Lock( Jul 25 21:21:24.121680 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:21:24.121680 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:21:24.121680 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:21:24.121680 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:21:24.122439 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:21:24.122439 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:21:24.122439 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:21:24.122439 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:21:24.122439 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:21:24.122439 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:21:24.122439 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:21:24.122439 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:21:24.122439 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:21:24.122439 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:21:24.122439 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 21:21:24.122439 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Jul 25 21:21:24.124788 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 32/67] 10.222.0.66 () {56 vars in 1096 bytes} [Mon Jul 25 21:21:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 21:21:24.130580 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401f34ee-58db-4352-a7a4-f0e687323666 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:24.134994 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 36/68] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:21:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 21:21:24.136022 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026d73cb-81d6-407b-80a7-8008c39dd0ad None None] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:24.240422 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401f34ee-58db-4352-a7a4-f0e687323666 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:24.249984 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026d73cb-81d6-407b-80a7-8008c39dd0ad None None] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:24.252180 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:24.269484 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:24.277971 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c510a44e-1084-45c1-9c94-1d8ec3bea5e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:24.278634 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c510a44e-1084-45c1-9c94-1d8ec3bea5e0 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:24.278915 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c510a44e-1084-45c1-9c94-1d8ec3bea5e0 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:24.279192 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c510a44e-1084-45c1-9c94-1d8ec3bea5e0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:24.288050 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88637a34-778b-4eaa-a107-2c5b880e4806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:24.288689 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88637a34-778b-4eaa-a107-2c5b880e4806 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:24.288974 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88637a34-778b-4eaa-a107-2c5b880e4806 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:24.289283 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88637a34-778b-4eaa-a107-2c5b880e4806 None admin] PATH_INFO: `/v3/roles` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:24.290319 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88637a34-778b-4eaa-a107-2c5b880e4806 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:21:24.290634 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88637a34-778b-4eaa-a107-2c5b880e4806 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:24.290823 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c510a44e-1084-45c1-9c94-1d8ec3bea5e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:21:24.292102 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88637a34-778b-4eaa-a107-2c5b880e4806 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:24.295820 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application [None req-c510a44e-1084-45c1-9c94-1d8ec3bea5e0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 21:21:24.295820 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:21:24.295820 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:21:24.295820 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:21:24.295820 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:21:24.295820 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:21:24.295820 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:21:24.295820 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:21:24.295820 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:21:24.295820 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:21:24.295820 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:21:24.295820 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:21:24.295820 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:21:24.295820 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:21:24.295820 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:21:24.295820 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:21:24.296669 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:21:24.296669 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:21:24.296669 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:21:24.296669 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:21:24.296669 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:21:24.296669 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:21:24.296669 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:21:24.296669 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:21:24.296669 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:21:24.296669 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:21:24.296669 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:21:24.296669 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application with Lock( Jul 25 21:21:24.296669 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:21:24.296669 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:21:24.296669 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:21:24.296669 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:21:24.297754 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:21:24.297754 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:21:24.297754 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:21:24.297754 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:21:24.297754 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:21:24.297754 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:21:24.297754 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:21:24.297754 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:21:24.297754 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:21:24.297754 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:21:24.297754 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 21:21:24.297754 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Jul 25 21:21:24.297754 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 33/69] 10.222.0.66 () {56 vars in 1114 bytes} [Mon Jul 25 21:21:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:21:24.298422 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c510a44e-1084-45c1-9c94-1d8ec3bea5e0 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:24.303451 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 37/70] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Jul 25 21:21:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:21:24.306573 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b230cebe-83e1-4323-83f4-a7d8328f8dc9 None None] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:24.306573 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b230cebe-83e1-4323-83f4-a7d8328f8dc9 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:24.306573 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b230cebe-83e1-4323-83f4-a7d8328f8dc9 None None] PATH_INFO: `/` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:24.307073 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 38/71] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:21:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:21:24.307467 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b230cebe-83e1-4323-83f4-a7d8328f8dc9 None None] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:24.408211 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c510a44e-1084-45c1-9c94-1d8ec3bea5e0 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:24.414625 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b230cebe-83e1-4323-83f4-a7d8328f8dc9 None None] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:24.441784 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1c4b0b-0308-4e0f-9ea7-5f87994a0d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:24.442436 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1c4b0b-0308-4e0f-9ea7-5f87994a0d1c None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:24.442712 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1c4b0b-0308-4e0f-9ea7-5f87994a0d1c None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:24.442984 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1c4b0b-0308-4e0f-9ea7-5f87994a0d1c None admin] PATH_INFO: `/v3/roles/member` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:24.449641 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395e6f4b-bf21-418c-ba72-fd15f8a87e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:24.450271 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395e6f4b-bf21-418c-ba72-fd15f8a87e82 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:24.450553 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395e6f4b-bf21-418c-ba72-fd15f8a87e82 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:24.450830 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395e6f4b-bf21-418c-ba72-fd15f8a87e82 None admin] PATH_INFO: `/v3/roles` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:24.451548 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395e6f4b-bf21-418c-ba72-fd15f8a87e82 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:21:24.451857 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395e6f4b-bf21-418c-ba72-fd15f8a87e82 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:24.452879 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1c4b0b-0308-4e0f-9ea7-5f87994a0d1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:21:24.453284 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395e6f4b-bf21-418c-ba72-fd15f8a87e82 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:24.457877 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application [None req-0f1c4b0b-0308-4e0f-9ea7-5f87994a0d1c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 21:21:24.457877 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:21:24.457877 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:21:24.457877 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:21:24.457877 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:21:24.457877 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:21:24.457877 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:21:24.457877 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:21:24.457877 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:21:24.457877 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:21:24.457877 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:21:24.457877 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:21:24.457877 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:21:24.457877 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:21:24.457877 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:21:24.457877 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:21:24.458711 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:21:24.458711 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:21:24.458711 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:21:24.458711 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:21:24.458711 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:21:24.458711 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:21:24.458711 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:21:24.458711 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:21:24.458711 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:21:24.458711 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:21:24.458711 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:21:24.458711 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application with Lock( Jul 25 21:21:24.458711 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:21:24.458711 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:21:24.458711 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:21:24.458711 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:21:24.459456 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:21:24.459456 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:21:24.459456 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:21:24.459456 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:21:24.459456 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:21:24.459456 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:21:24.459456 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:21:24.459456 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:21:24.459456 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:21:24.459456 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:21:24.459456 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 21:21:24.459456 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Jul 25 21:21:24.459456 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 34/72] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Jul 25 21:21:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:21:24.460096 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1c4b0b-0308-4e0f-9ea7-5f87994a0d1c None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:24.466465 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 39/73] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Jul 25 21:21:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:21:24.467723 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e2a87f-016b-4b21-8b88-457aab58c6e4 None None] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:24.468017 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e2a87f-016b-4b21-8b88-457aab58c6e4 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:24.468299 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e2a87f-016b-4b21-8b88-457aab58c6e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:24.486946 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.auth.core [None req-65e2a87f-016b-4b21-8b88-457aab58c6e4 None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:21:24.488280 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-65e2a87f-016b-4b21-8b88-457aab58c6e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:21:24.492423 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:24.529326 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:24.564332 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 40/74] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:21:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:21:24.572102 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4665cf2f-e225-4839-ada7-8120c08728cd None None] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:24.572102 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4665cf2f-e225-4839-ada7-8120c08728cd None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:24.572102 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4665cf2f-e225-4839-ada7-8120c08728cd None None] PATH_INFO: `/` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:24.572102 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 41/75] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:21:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:21:24.572102 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4665cf2f-e225-4839-ada7-8120c08728cd None None] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:24.577406 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1c4b0b-0308-4e0f-9ea7-5f87994a0d1c None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:24.615104 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ce75b6-ebaf-4752-a055-eee53f4d2fe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:24.615837 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ce75b6-ebaf-4752-a055-eee53f4d2fe2 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:24.616116 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ce75b6-ebaf-4752-a055-eee53f4d2fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:24.616374 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ce75b6-ebaf-4752-a055-eee53f4d2fe2 None admin] PATH_INFO: `/v3/users/1e6cadb2f0fe422088a106e6a578b2f7` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:24.617609 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ce75b6-ebaf-4752-a055-eee53f4d2fe2 None admin] RBAC: Authorizing `identity:get_user(user_id=1e6cadb2f0fe422088a106e6a578b2f7)` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:24.619107 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ce75b6-ebaf-4752-a055-eee53f4d2fe2 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:24.620871 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 35/76] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Jul 25 21:21:24 2022] GET /identity/v3/users/1e6cadb2f0fe422088a106e6a578b2f7 => generated 247 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:21:24.621500 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ce75b6-ebaf-4752-a055-eee53f4d2fe2 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:24.675320 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4665cf2f-e225-4839-ada7-8120c08728cd None None] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:24.710454 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e22bfea-24aa-4adc-a1d3-44ced2914f7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:24.711075 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e22bfea-24aa-4adc-a1d3-44ced2914f7d None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:24.711357 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e22bfea-24aa-4adc-a1d3-44ced2914f7d None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:24.711632 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e22bfea-24aa-4adc-a1d3-44ced2914f7d None admin] PATH_INFO: `/v3/roles` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:24.712355 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e22bfea-24aa-4adc-a1d3-44ced2914f7d None admin] RBAC: Adding query filter params (name=member) {{(pid=87209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:21:24.712784 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e22bfea-24aa-4adc-a1d3-44ced2914f7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:24.714114 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e22bfea-24aa-4adc-a1d3-44ced2914f7d None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:24.718105 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:24.722675 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 42/77] 10.222.0.66 () {56 vars in 1101 bytes} [Mon Jul 25 21:21:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:21:24.722813 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ce75b6-ebaf-4752-a055-eee53f4d2fe2 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:24.728615 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a799f105-ca23-425e-84ab-15c4d680f1d4 None None] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:24.728906 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a799f105-ca23-425e-84ab-15c4d680f1d4 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:24.729214 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a799f105-ca23-425e-84ab-15c4d680f1d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:24.752092 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.auth.core [None req-a799f105-ca23-425e-84ab-15c4d680f1d4 None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:21:24.753358 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-a799f105-ca23-425e-84ab-15c4d680f1d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:21:24.764933 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d9d71c-effa-4602-ba5c-93c5179e1ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:24.765620 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d9d71c-effa-4602-ba5c-93c5179e1ee1 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:24.765900 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d9d71c-effa-4602-ba5c-93c5179e1ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:24.766172 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d9d71c-effa-4602-ba5c-93c5179e1ee1 None admin] PATH_INFO: `/v3/users/598778bbdcb54a8eac7f2dcc1a1357d8` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:24.779845 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:24.781627 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d9d71c-effa-4602-ba5c-93c5179e1ee1 None admin] RBAC: Authorizing `identity:get_user(user_id=598778bbdcb54a8eac7f2dcc1a1357d8)` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:24.783360 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d9d71c-effa-4602-ba5c-93c5179e1ee1 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:24.785145 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 36/78] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Jul 25 21:21:24 2022] GET /identity/v3/users/598778bbdcb54a8eac7f2dcc1a1357d8 => generated 275 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:21:24.785904 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d9d71c-effa-4602-ba5c-93c5179e1ee1 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:24.822146 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 43/79] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:21:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:21:24.822993 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a799f105-ca23-425e-84ab-15c4d680f1d4 None None] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:24.887638 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d9d71c-effa-4602-ba5c-93c5179e1ee1 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:24.921578 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9187aa-6457-4d78-9fc1-c0760149c2a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:24.922237 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9187aa-6457-4d78-9fc1-c0760149c2a6 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:24.922519 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9187aa-6457-4d78-9fc1-c0760149c2a6 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:24.922634 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a799f105-ca23-425e-84ab-15c4d680f1d4 None None] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:24.922794 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9187aa-6457-4d78-9fc1-c0760149c2a6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:24.932935 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9187aa-6457-4d78-9fc1-c0760149c2a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:21:24.937888 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application [None req-7a9187aa-6457-4d78-9fc1-c0760149c2a6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 21:21:24.937888 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:21:24.937888 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:21:24.937888 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:21:24.937888 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:21:24.937888 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:21:24.937888 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:21:24.937888 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:21:24.937888 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:21:24.937888 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:21:24.937888 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:21:24.937888 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:21:24.937888 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:21:24.937888 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:21:24.937888 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:21:24.937888 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:21:24.938743 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:21:24.938743 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:21:24.938743 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:21:24.938743 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:21:24.938743 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:21:24.938743 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:21:24.938743 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:21:24.938743 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:21:24.938743 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:21:24.938743 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:21:24.938743 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:21:24.938743 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application with Lock( Jul 25 21:21:24.938743 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:21:24.938743 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:21:24.938743 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:21:24.938743 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:21:24.939723 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:21:24.939723 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:21:24.939723 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:21:24.939723 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:21:24.939723 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:21:24.939723 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:21:24.939723 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:21:24.939723 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:21:24.939723 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:21:24.939723 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:21:24.939723 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 21:21:24.939723 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Jul 25 21:21:24.939723 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 37/80] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Jul 25 21:21:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:21:24.940614 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9187aa-6457-4d78-9fc1-c0760149c2a6 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:24.961387 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:24.964741 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c88611-11d9-4b76-9933-4c83107dda63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:24.965462 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c88611-11d9-4b76-9933-4c83107dda63 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:24.966105 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c88611-11d9-4b76-9933-4c83107dda63 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:24.966105 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c88611-11d9-4b76-9933-4c83107dda63 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:25.002431 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:25.039464 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c88611-11d9-4b76-9933-4c83107dda63 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:25.041343 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c88611-11d9-4b76-9933-4c83107dda63 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:25.045802 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9187aa-6457-4d78-9fc1-c0760149c2a6 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:25.081340 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be11dca-d237-4093-92f0-c82573701d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:25.082019 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be11dca-d237-4093-92f0-c82573701d1f None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:25.082300 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be11dca-d237-4093-92f0-c82573701d1f None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:25.082575 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be11dca-d237-4093-92f0-c82573701d1f None admin] PATH_INFO: `/v3/users/598778bbdcb54a8eac7f2dcc1a1357d8` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:25.083782 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be11dca-d237-4093-92f0-c82573701d1f None admin] RBAC: Authorizing `identity:get_user(user_id=598778bbdcb54a8eac7f2dcc1a1357d8)` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:25.085304 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be11dca-d237-4093-92f0-c82573701d1f None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:25.086965 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 38/81] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Jul 25 21:21:24 2022] GET /identity/v3/users/598778bbdcb54a8eac7f2dcc1a1357d8 => generated 275 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:21:25.087757 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be11dca-d237-4093-92f0-c82573701d1f None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:25.139861 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 44/82] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Jul 25 21:21:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 21:21:25.141025 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c88611-11d9-4b76-9933-4c83107dda63 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:25.180628 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:25.196572 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be11dca-d237-4093-92f0-c82573701d1f None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:25.201757 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:25.230531 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b438293-d51c-4f89-b679-42aebac93350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:25.231153 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b438293-d51c-4f89-b679-42aebac93350 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:25.231435 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b438293-d51c-4f89-b679-42aebac93350 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:25.231682 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b438293-d51c-4f89-b679-42aebac93350 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:25.240820 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c88611-11d9-4b76-9933-4c83107dda63 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:25.275025 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc326c5b-dee6-4af3-977c-9c7353392b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:25.275681 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc326c5b-dee6-4af3-977c-9c7353392b15 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:25.275960 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc326c5b-dee6-4af3-977c-9c7353392b15 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:25.276234 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc326c5b-dee6-4af3-977c-9c7353392b15 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:25.277439 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc326c5b-dee6-4af3-977c-9c7353392b15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:25.278901 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc326c5b-dee6-4af3-977c-9c7353392b15 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:25.280493 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 45/83] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 25 21:21:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:21:25.281283 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc326c5b-dee6-4af3-977c-9c7353392b15 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:25.300604 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b438293-d51c-4f89-b679-42aebac93350 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:25.302077 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b438293-d51c-4f89-b679-42aebac93350 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:25.378763 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc326c5b-dee6-4af3-977c-9c7353392b15 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:25.384628 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:25.401228 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 39/84] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Jul 25 21:21:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 21:21:25.402133 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b438293-d51c-4f89-b679-42aebac93350 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:25.409279 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:25.416212 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325a3f8f-1ce0-42c6-a6d5-980c4669653e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:25.416851 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325a3f8f-1ce0-42c6-a6d5-980c4669653e None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:25.417163 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325a3f8f-1ce0-42c6-a6d5-980c4669653e None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:25.417443 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325a3f8f-1ce0-42c6-a6d5-980c4669653e None admin] PATH_INFO: `/v3/roles` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:25.418169 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325a3f8f-1ce0-42c6-a6d5-980c4669653e None admin] RBAC: Adding query filter params (name=member) {{(pid=87209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:21:25.418475 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325a3f8f-1ce0-42c6-a6d5-980c4669653e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:25.419961 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325a3f8f-1ce0-42c6-a6d5-980c4669653e None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:25.428802 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 46/85] 10.222.0.66 () {56 vars in 1101 bytes} [Mon Jul 25 21:21:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:21:25.433458 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325a3f8f-1ce0-42c6-a6d5-980c4669653e None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:25.505440 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b438293-d51c-4f89-b679-42aebac93350 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:25.534044 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325a3f8f-1ce0-42c6-a6d5-980c4669653e None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:25.540802 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6e6b90-e055-406b-9a26-bbcb1d1c562b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:25.541469 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6e6b90-e055-406b-9a26-bbcb1d1c562b None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:25.541743 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6e6b90-e055-406b-9a26-bbcb1d1c562b None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:25.542011 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6e6b90-e055-406b-9a26-bbcb1d1c562b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:25.572573 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c50d86d-b5e0-4b65-b759-299be65d06ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:25.573190 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c50d86d-b5e0-4b65-b759-299be65d06ee None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:25.573503 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c50d86d-b5e0-4b65-b759-299be65d06ee None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:25.573784 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c50d86d-b5e0-4b65-b759-299be65d06ee None admin] PATH_INFO: `/v3/projects/d8086440d31c4402a8800ca68927d7e1` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:25.574972 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c50d86d-b5e0-4b65-b759-299be65d06ee None admin] RBAC: Authorizing `identity:get_project(project_id=d8086440d31c4402a8800ca68927d7e1)` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:25.576455 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c50d86d-b5e0-4b65-b759-299be65d06ee None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:25.578425 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 47/86] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Jul 25 21:21:25 2022] GET /identity/v3/projects/d8086440d31c4402a8800ca68927d7e1 => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:21:25.578943 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c50d86d-b5e0-4b65-b759-299be65d06ee None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:25.598215 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:25.614909 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6e6b90-e055-406b-9a26-bbcb1d1c562b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:25.617168 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6e6b90-e055-406b-9a26-bbcb1d1c562b None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:25.642063 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:25.682565 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c50d86d-b5e0-4b65-b759-299be65d06ee None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:25.716357 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171fe0ea-8c81-4ced-a218-2efaafe23a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:25.716983 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171fe0ea-8c81-4ced-a218-2efaafe23a44 None admin] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:25.717288 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171fe0ea-8c81-4ced-a218-2efaafe23a44 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:25.717562 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171fe0ea-8c81-4ced-a218-2efaafe23a44 None admin] PATH_INFO: `/v3/users` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:25.718240 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171fe0ea-8c81-4ced-a218-2efaafe23a44 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:25.719711 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171fe0ea-8c81-4ced-a218-2efaafe23a44 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:25.720258 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 40/87] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Jul 25 21:21:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 21:21:25.721313 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6e6b90-e055-406b-9a26-bbcb1d1c562b None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:25.748243 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 48/88] 10.222.0.66 () {60 vars in 1132 bytes} [Mon Jul 25 21:21:25 2022] POST /identity/v3/users => generated 289 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 21:21:25.749229 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171fe0ea-8c81-4ced-a218-2efaafe23a44 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:25.828579 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:25.849461 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6e6b90-e055-406b-9a26-bbcb1d1c562b None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:25.866946 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171fe0ea-8c81-4ced-a218-2efaafe23a44 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:25.886937 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33af3886-91a6-4559-ad99-d4b14d86da67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:25.887524 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:25.888888 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33af3886-91a6-4559-ad99-d4b14d86da67 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:25.889398 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33af3886-91a6-4559-ad99-d4b14d86da67 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:25.889923 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33af3886-91a6-4559-ad99-d4b14d86da67 None admin] PATH_INFO: `/v3/projects/d8086440d31c4402a8800ca68927d7e1` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:25.892118 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33af3886-91a6-4559-ad99-d4b14d86da67 None admin] RBAC: Authorizing `identity:get_project(project_id=d8086440d31c4402a8800ca68927d7e1)` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:25.894255 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33af3886-91a6-4559-ad99-d4b14d86da67 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:25.896219 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 41/89] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Jul 25 21:21:25 2022] GET /identity/v3/projects/d8086440d31c4402a8800ca68927d7e1 => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:21:25.902425 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33af3886-91a6-4559-ad99-d4b14d86da67 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:25.907629 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142f1bd0-15bf-4972-8ad1-08ac71523977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:25.908559 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142f1bd0-15bf-4972-8ad1-08ac71523977 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:25.909011 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142f1bd0-15bf-4972-8ad1-08ac71523977 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:25.909454 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142f1bd0-15bf-4972-8ad1-08ac71523977 None admin] PATH_INFO: `/v3/users/598778bbdcb54a8eac7f2dcc1a1357d8` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:25.910848 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142f1bd0-15bf-4972-8ad1-08ac71523977 None admin] RBAC: Authorizing `identity:get_user(user_id=598778bbdcb54a8eac7f2dcc1a1357d8)` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:25.912641 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142f1bd0-15bf-4972-8ad1-08ac71523977 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:25.914664 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 49/90] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Jul 25 21:21:25 2022] GET /identity/v3/users/598778bbdcb54a8eac7f2dcc1a1357d8 => generated 275 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:21:25.916133 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142f1bd0-15bf-4972-8ad1-08ac71523977 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:26.033737 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33af3886-91a6-4559-ad99-d4b14d86da67 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:26.056642 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142f1bd0-15bf-4972-8ad1-08ac71523977 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:26.076654 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37055403-1480-4f94-82e9-cc1c5ba7d7e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:26.077362 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37055403-1480-4f94-82e9-cc1c5ba7d7e1 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:26.077645 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37055403-1480-4f94-82e9-cc1c5ba7d7e1 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:26.077922 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37055403-1480-4f94-82e9-cc1c5ba7d7e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:26.078775 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37055403-1480-4f94-82e9-cc1c5ba7d7e1 None admin] RBAC: Adding query filter params (role.id=216a86497a3a4593ba08730ea8697df3, scope.project.id=d8086440d31c4402a8800ca68927d7e1, user.id=1e6cadb2f0fe422088a106e6a578b2f7) {{(pid=87210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:21:26.079032 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37055403-1480-4f94-82e9-cc1c5ba7d7e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:26.080634 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37055403-1480-4f94-82e9-cc1c5ba7d7e1 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:26.086322 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 42/91] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Jul 25 21:21:25 2022] GET /identity/v3/role_assignments?user.id=1e6cadb2f0fe422088a106e6a578b2f7&scope.project.id=d8086440d31c4402a8800ca68927d7e1&role.id=216a86497a3a4593ba08730ea8697df3 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:21:26.087147 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37055403-1480-4f94-82e9-cc1c5ba7d7e1 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:26.103302 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0385764-1ce8-4cbc-adc4-ac98ed0db291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:26.104042 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0385764-1ce8-4cbc-adc4-ac98ed0db291 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:26.104337 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0385764-1ce8-4cbc-adc4-ac98ed0db291 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:26.104645 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0385764-1ce8-4cbc-adc4-ac98ed0db291 None admin] PATH_INFO: `/v3/projects/d8086440d31c4402a8800ca68927d7e1` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:26.106152 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0385764-1ce8-4cbc-adc4-ac98ed0db291 None admin] RBAC: Authorizing `identity:get_project(project_id=d8086440d31c4402a8800ca68927d7e1)` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:26.107717 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0385764-1ce8-4cbc-adc4-ac98ed0db291 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:26.109657 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 50/92] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Jul 25 21:21:25 2022] GET /identity/v3/projects/d8086440d31c4402a8800ca68927d7e1 => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:21:26.110745 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0385764-1ce8-4cbc-adc4-ac98ed0db291 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:26.118001 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:26.183522 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:26.216454 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37055403-1480-4f94-82e9-cc1c5ba7d7e1 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:26.258234 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0385764-1ce8-4cbc-adc4-ac98ed0db291 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:26.273207 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e38fe36-a289-4e5f-bff5-6b2258cf62ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:26.273866 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e38fe36-a289-4e5f-bff5-6b2258cf62ba None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:26.274152 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e38fe36-a289-4e5f-bff5-6b2258cf62ba None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:26.274436 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e38fe36-a289-4e5f-bff5-6b2258cf62ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:26.275251 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e38fe36-a289-4e5f-bff5-6b2258cf62ba None admin] RBAC: Adding query filter params (role.id=f910595b432f450eb4b382e0c99cf932, scope.project.id=d8086440d31c4402a8800ca68927d7e1, user.id=598778bbdcb54a8eac7f2dcc1a1357d8) {{(pid=87210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:21:26.275568 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e38fe36-a289-4e5f-bff5-6b2258cf62ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:26.277120 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e38fe36-a289-4e5f-bff5-6b2258cf62ba None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:26.293907 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 43/93] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Jul 25 21:21:26 2022] GET /identity/v3/role_assignments?user.id=598778bbdcb54a8eac7f2dcc1a1357d8&scope.project.id=d8086440d31c4402a8800ca68927d7e1&role.id=f910595b432f450eb4b382e0c99cf932 => generated 259 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:21:26.295388 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e38fe36-a289-4e5f-bff5-6b2258cf62ba None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:26.334582 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4ef11e-0c37-45cb-8a0b-556f06ddd802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:26.335830 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4ef11e-0c37-45cb-8a0b-556f06ddd802 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:26.336117 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4ef11e-0c37-45cb-8a0b-556f06ddd802 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:26.336393 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4ef11e-0c37-45cb-8a0b-556f06ddd802 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:26.444856 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4ef11e-0c37-45cb-8a0b-556f06ddd802 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:26.446860 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4ef11e-0c37-45cb-8a0b-556f06ddd802 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:26.473409 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:26.503526 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e38fe36-a289-4e5f-bff5-6b2258cf62ba None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:26.550342 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:26.572813 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dab054a-2f8a-48e7-960f-44999123e7bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:26.574864 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dab054a-2f8a-48e7-960f-44999123e7bc None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:26.575477 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dab054a-2f8a-48e7-960f-44999123e7bc None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:26.575988 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dab054a-2f8a-48e7-960f-44999123e7bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:26.578023 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dab054a-2f8a-48e7-960f-44999123e7bc None admin] RBAC: Adding query filter params (role.id=faec70ea0ba040efa587f542f054e49e, scope.project.id=d8086440d31c4402a8800ca68927d7e1, user.id=598778bbdcb54a8eac7f2dcc1a1357d8) {{(pid=87210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:21:26.578705 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dab054a-2f8a-48e7-960f-44999123e7bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:26.582146 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dab054a-2f8a-48e7-960f-44999123e7bc None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:26.597269 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 44/94] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Jul 25 21:21:26 2022] GET /identity/v3/role_assignments?user.id=598778bbdcb54a8eac7f2dcc1a1357d8&scope.project.id=d8086440d31c4402a8800ca68927d7e1&role.id=faec70ea0ba040efa587f542f054e49e => generated 259 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:21:26.630144 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 51/95] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Jul 25 21:21:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 21:21:26.637050 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dab054a-2f8a-48e7-960f-44999123e7bc None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:26.783378 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dab054a-2f8a-48e7-960f-44999123e7bc None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:26.833270 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b37554-d606-4458-b62b-972294b28052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:26.834115 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b37554-d606-4458-b62b-972294b28052 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:26.834243 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b37554-d606-4458-b62b-972294b28052 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:26.834504 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b37554-d606-4458-b62b-972294b28052 None admin] PATH_INFO: `/v3/projects/6b3d6a0f3788448cbaba3c0da736a4a8` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:26.835751 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b37554-d606-4458-b62b-972294b28052 None admin] RBAC: Authorizing `identity:get_project(project_id=6b3d6a0f3788448cbaba3c0da736a4a8)` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:26.837258 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b37554-d606-4458-b62b-972294b28052 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:26.838937 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 45/96] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Jul 25 21:21:26 2022] GET /identity/v3/projects/6b3d6a0f3788448cbaba3c0da736a4a8 => generated 312 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:21:26.845131 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4ef11e-0c37-45cb-8a0b-556f06ddd802 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:27.022068 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4ef11e-0c37-45cb-8a0b-556f06ddd802 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:27.078074 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcc4d25-e241-4571-8f68-b25ef356019b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:27.078702 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcc4d25-e241-4571-8f68-b25ef356019b None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:27.078978 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcc4d25-e241-4571-8f68-b25ef356019b None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:27.079249 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcc4d25-e241-4571-8f68-b25ef356019b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:27.080075 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcc4d25-e241-4571-8f68-b25ef356019b None admin] RBAC: Adding query filter params (role.id=faec70ea0ba040efa587f542f054e49e, scope.project.id=6b3d6a0f3788448cbaba3c0da736a4a8, user.id=598778bbdcb54a8eac7f2dcc1a1357d8) {{(pid=87209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:21:27.080440 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcc4d25-e241-4571-8f68-b25ef356019b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:27.081926 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcc4d25-e241-4571-8f68-b25ef356019b None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:27.093257 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 52/97] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Jul 25 21:21:26 2022] GET /identity/v3/role_assignments?user.id=598778bbdcb54a8eac7f2dcc1a1357d8&scope.project.id=6b3d6a0f3788448cbaba3c0da736a4a8&role.id=faec70ea0ba040efa587f542f054e49e => generated 259 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:21:28.619290 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e7d5d1-68b8-4e53-83d9-1f581ea967ae None None] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:28.620406 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e7d5d1-68b8-4e53-83d9-1f581ea967ae None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:28.620888 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e7d5d1-68b8-4e53-83d9-1f581ea967ae None None] PATH_INFO: `/` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:28.622526 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 46/98] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:21:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:21:28.628050 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab38e500-b538-4ba5-85b9-e2731e111d7b None None] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:28.628472 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab38e500-b538-4ba5-85b9-e2731e111d7b None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:28.628648 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab38e500-b538-4ba5-85b9-e2731e111d7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:28.658169 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.auth.core [None req-ab38e500-b538-4ba5-85b9-e2731e111d7b None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:21:28.659398 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-ab38e500-b538-4ba5-85b9-e2731e111d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:21:28.674068 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:28.747111 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 53/99] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:21:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:21:28.784478 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e7d5d1-68b8-4e53-83d9-1f581ea967ae None None] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:28.806028 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:28.934644 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e7d5d1-68b8-4e53-83d9-1f581ea967ae None None] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:28.994812 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782393fd-c00d-47a7-bc19-ed722059c152 None None] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:28.995093 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782393fd-c00d-47a7-bc19-ed722059c152 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:28.995548 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782393fd-c00d-47a7-bc19-ed722059c152 None None] PATH_INFO: `/` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:28.997070 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 54/100] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:21:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 21:21:29.001545 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978b7d31-fc06-40a3-94bd-560f7c2941df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:29.002607 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978b7d31-fc06-40a3-94bd-560f7c2941df None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:29.002900 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978b7d31-fc06-40a3-94bd-560f7c2941df None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:29.003179 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978b7d31-fc06-40a3-94bd-560f7c2941df None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:29.004894 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163feeb6-2787-40af-a872-0873dba07b3a None None] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:29.005466 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163feeb6-2787-40af-a872-0873dba07b3a None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:29.005950 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163feeb6-2787-40af-a872-0873dba07b3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:29.025266 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978b7d31-fc06-40a3-94bd-560f7c2941df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:21:29.028413 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.auth.core [None req-163feeb6-2787-40af-a872-0873dba07b3a None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:21:29.029956 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-163feeb6-2787-40af-a872-0873dba07b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:21:29.035301 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application [None req-978b7d31-fc06-40a3-94bd-560f7c2941df None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 21:21:29.035301 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:21:29.035301 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:21:29.035301 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:21:29.035301 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:21:29.035301 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:21:29.035301 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:21:29.035301 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:21:29.035301 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:21:29.035301 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:21:29.035301 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:21:29.035301 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:21:29.035301 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:21:29.035301 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:21:29.035301 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:21:29.035301 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:21:29.036561 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:21:29.036561 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:21:29.036561 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:21:29.036561 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:21:29.036561 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:21:29.036561 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:21:29.036561 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:21:29.036561 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:21:29.036561 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:21:29.036561 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:21:29.036561 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:21:29.036561 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application with Lock( Jul 25 21:21:29.036561 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:21:29.036561 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:21:29.036561 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:21:29.036561 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:21:29.037927 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:21:29.037927 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:21:29.037927 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:21:29.037927 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:21:29.037927 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:21:29.037927 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:21:29.037927 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:21:29.037927 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:21:29.037927 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:21:29.037927 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:21:29.037927 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 21:21:29.037927 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Jul 25 21:21:29.037927 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 47/101] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Jul 25 21:21:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:21:29.044969 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978b7d31-fc06-40a3-94bd-560f7c2941df None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:29.181913 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 55/102] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:21:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:21:29.186475 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4046811-24dc-49d2-a28e-bbb989675b64 None None] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:29.186995 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4046811-24dc-49d2-a28e-bbb989675b64 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:29.187758 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4046811-24dc-49d2-a28e-bbb989675b64 None None] PATH_INFO: `/` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:29.190185 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 56/103] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:21:29 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:21:29.198806 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d49d631-c889-456c-8a10-18b75fb9736f None None] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:29.199102 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d49d631-c889-456c-8a10-18b75fb9736f None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:29.199359 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d49d631-c889-456c-8a10-18b75fb9736f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:29.215262 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:29.240923 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.auth.core [None req-5d49d631-c889-456c-8a10-18b75fb9736f None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:21:29.242155 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-5d49d631-c889-456c-8a10-18b75fb9736f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:21:29.264882 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978b7d31-fc06-40a3-94bd-560f7c2941df None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:29.324719 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4d8209-2f17-4e56-aaf3-83f209ff941c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:29.325756 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4d8209-2f17-4e56-aaf3-83f209ff941c None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:29.326351 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4d8209-2f17-4e56-aaf3-83f209ff941c None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:29.326830 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4d8209-2f17-4e56-aaf3-83f209ff941c None admin] PATH_INFO: `/v3/roles` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:29.327761 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4d8209-2f17-4e56-aaf3-83f209ff941c None admin] RBAC: Adding query filter params (name=reader) {{(pid=87210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:21:29.328266 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4d8209-2f17-4e56-aaf3-83f209ff941c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:29.330164 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4d8209-2f17-4e56-aaf3-83f209ff941c None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:29.345639 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 48/104] 10.222.0.66 () {56 vars in 1101 bytes} [Mon Jul 25 21:21:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:21:29.347224 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4d8209-2f17-4e56-aaf3-83f209ff941c None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:29.440398 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 57/105] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:21:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:21:29.441781 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d49d631-c889-456c-8a10-18b75fb9736f None None] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:29.482543 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:29.500145 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4d8209-2f17-4e56-aaf3-83f209ff941c None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:29.546978 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aed1c4-7c26-4dc3-9c73-e01996bf0637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:29.548052 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aed1c4-7c26-4dc3-9c73-e01996bf0637 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:29.548866 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aed1c4-7c26-4dc3-9c73-e01996bf0637 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:29.549579 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aed1c4-7c26-4dc3-9c73-e01996bf0637 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:29.552556 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:29.564511 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aed1c4-7c26-4dc3-9c73-e01996bf0637 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:21:29.570404 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application [None req-d6aed1c4-7c26-4dc3-9c73-e01996bf0637 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 21:21:29.570404 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:21:29.570404 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:21:29.570404 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:21:29.570404 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:21:29.570404 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:21:29.570404 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:21:29.570404 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:21:29.570404 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:21:29.570404 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:21:29.570404 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:21:29.570404 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:21:29.570404 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:21:29.570404 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:21:29.570404 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:21:29.570404 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:21:29.571300 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:21:29.571300 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:21:29.571300 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:21:29.571300 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:21:29.571300 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:21:29.571300 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:21:29.571300 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:21:29.571300 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:21:29.571300 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:21:29.571300 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:21:29.571300 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:21:29.571300 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application with Lock( Jul 25 21:21:29.571300 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:21:29.571300 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:21:29.571300 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:21:29.571300 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:21:29.572105 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:21:29.572105 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:21:29.572105 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:21:29.572105 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:21:29.572105 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:21:29.572105 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:21:29.572105 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:21:29.572105 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:21:29.572105 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:21:29.572105 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:21:29.572105 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 21:21:29.572105 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Jul 25 21:21:29.574818 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 49/106] 10.222.0.66 () {56 vars in 1096 bytes} [Mon Jul 25 21:21:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:21:29.575900 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aed1c4-7c26-4dc3-9c73-e01996bf0637 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:29.705321 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d49d631-c889-456c-8a10-18b75fb9736f None None] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:29.719091 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aed1c4-7c26-4dc3-9c73-e01996bf0637 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:29.773395 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4759f23f-3cf3-47ca-9fad-ae8089c839c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:29.774525 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4759f23f-3cf3-47ca-9fad-ae8089c839c9 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:29.775080 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4759f23f-3cf3-47ca-9fad-ae8089c839c9 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:29.775595 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4759f23f-3cf3-47ca-9fad-ae8089c839c9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:29.777183 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4759f23f-3cf3-47ca-9fad-ae8089c839c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:29.778941 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4759f23f-3cf3-47ca-9fad-ae8089c839c9 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:29.782057 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 50/107] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 25 21:21:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:21:29.783328 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4759f23f-3cf3-47ca-9fad-ae8089c839c9 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:29.814823 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c09a235-7a8e-47d2-8d1a-3f7a9d3f80a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:29.815506 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c09a235-7a8e-47d2-8d1a-3f7a9d3f80a6 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:29.815796 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c09a235-7a8e-47d2-8d1a-3f7a9d3f80a6 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:29.816060 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c09a235-7a8e-47d2-8d1a-3f7a9d3f80a6 None admin] PATH_INFO: `/v3/users/ddde747b461549108051f8e0a81f50fd` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:29.860361 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c09a235-7a8e-47d2-8d1a-3f7a9d3f80a6 None admin] RBAC: Authorizing `identity:get_user(user_id=ddde747b461549108051f8e0a81f50fd)` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:29.862161 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c09a235-7a8e-47d2-8d1a-3f7a9d3f80a6 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:29.864180 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 58/108] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Jul 25 21:21:29 2022] GET /identity/v3/users/ddde747b461549108051f8e0a81f50fd => generated 289 bytes in 424 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:21:29.865105 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c09a235-7a8e-47d2-8d1a-3f7a9d3f80a6 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:29.886664 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:29.945498 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4759f23f-3cf3-47ca-9fad-ae8089c839c9 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:29.991639 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc6de89-0991-4203-94f3-c94b2ce29428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:29.992382 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc6de89-0991-4203-94f3-c94b2ce29428 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:29.992762 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc6de89-0991-4203-94f3-c94b2ce29428 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:29.993171 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc6de89-0991-4203-94f3-c94b2ce29428 None admin] PATH_INFO: `/v3/roles` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:29.994005 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc6de89-0991-4203-94f3-c94b2ce29428 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:21:29.994411 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc6de89-0991-4203-94f3-c94b2ce29428 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:29.996501 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc6de89-0991-4203-94f3-c94b2ce29428 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:30.011830 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 51/109] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Jul 25 21:21:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:21:30.012681 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc6de89-0991-4203-94f3-c94b2ce29428 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:30.062255 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:30.131433 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc6de89-0991-4203-94f3-c94b2ce29428 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:30.146191 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c09a235-7a8e-47d2-8d1a-3f7a9d3f80a6 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:30.166097 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:30.188214 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9f8e81-c838-47ee-af46-a57909510474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:30.190514 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9f8e81-c838-47ee-af46-a57909510474 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:30.190985 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9f8e81-c838-47ee-af46-a57909510474 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:30.191410 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9f8e81-c838-47ee-af46-a57909510474 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:30.197117 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7370583-4589-4540-a65a-dffd331276ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:30.197117 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7370583-4589-4540-a65a-dffd331276ca None admin] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:30.197117 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7370583-4589-4540-a65a-dffd331276ca None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:30.197117 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7370583-4589-4540-a65a-dffd331276ca None admin] PATH_INFO: `/v3/projects` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:30.197576 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7370583-4589-4540-a65a-dffd331276ca None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:30.197576 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7370583-4589-4540-a65a-dffd331276ca None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:30.234381 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 59/110] 10.222.0.66 () {60 vars in 1141 bytes} [Mon Jul 25 21:21:29 2022] POST /identity/v3/projects => generated 302 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 21:21:30.235589 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7370583-4589-4540-a65a-dffd331276ca None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:30.340603 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9f8e81-c838-47ee-af46-a57909510474 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:30.342509 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9f8e81-c838-47ee-af46-a57909510474 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:30.359994 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7370583-4589-4540-a65a-dffd331276ca None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:30.386249 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:30.404817 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e07591f-e658-46e1-a80b-f359b164d634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:30.404817 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e07591f-e658-46e1-a80b-f359b164d634 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:30.404817 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e07591f-e658-46e1-a80b-f359b164d634 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:30.404817 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e07591f-e658-46e1-a80b-f359b164d634 None admin] PATH_INFO: `/v3/users/1e6cadb2f0fe422088a106e6a578b2f7` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:30.405305 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e07591f-e658-46e1-a80b-f359b164d634 None admin] RBAC: Authorizing `identity:get_user(user_id=1e6cadb2f0fe422088a106e6a578b2f7)` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:30.405305 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e07591f-e658-46e1-a80b-f359b164d634 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:30.405305 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 60/111] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Jul 25 21:21:30 2022] GET /identity/v3/users/1e6cadb2f0fe422088a106e6a578b2f7 => generated 247 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:21:30.412452 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e07591f-e658-46e1-a80b-f359b164d634 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:30.511136 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 52/112] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Jul 25 21:21:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 21:21:30.513811 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3067e080-4fed-469a-b3c0-6105c0bbc35e None None] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:30.514341 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3067e080-4fed-469a-b3c0-6105c0bbc35e None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:30.514865 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3067e080-4fed-469a-b3c0-6105c0bbc35e None None] PATH_INFO: `/` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:30.518294 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 53/113] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:21:30 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:21:30.520662 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3dc047-a3ac-4f7f-9244-bca6157247aa None None] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:30.521197 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3dc047-a3ac-4f7f-9244-bca6157247aa None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:30.521686 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3dc047-a3ac-4f7f-9244-bca6157247aa None None] PATH_INFO: `/` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:30.525098 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 54/114] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:21:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:21:30.532525 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3dc047-a3ac-4f7f-9244-bca6157247aa None None] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:30.583357 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:30.586762 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e07591f-e658-46e1-a80b-f359b164d634 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:30.634264 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad62161-703f-4d1e-9bb7-c75c8af36e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:30.634839 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad62161-703f-4d1e-9bb7-c75c8af36e63 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:30.635118 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad62161-703f-4d1e-9bb7-c75c8af36e63 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:30.635393 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad62161-703f-4d1e-9bb7-c75c8af36e63 None admin] PATH_INFO: `/v3/projects/d8086440d31c4402a8800ca68927d7e1` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:30.636549 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad62161-703f-4d1e-9bb7-c75c8af36e63 None admin] RBAC: Authorizing `identity:get_project(project_id=d8086440d31c4402a8800ca68927d7e1)` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:30.638608 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad62161-703f-4d1e-9bb7-c75c8af36e63 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:30.640021 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 61/115] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Jul 25 21:21:30 2022] GET /identity/v3/projects/d8086440d31c4402a8800ca68927d7e1 => generated 298 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:21:30.645944 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8824b61-2c8c-4f6e-b98d-a65c612a5d0a None None] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:30.646278 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8824b61-2c8c-4f6e-b98d-a65c612a5d0a None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:30.646839 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8824b61-2c8c-4f6e-b98d-a65c612a5d0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:30.666750 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.auth.core [None req-b8824b61-2c8c-4f6e-b98d-a65c612a5d0a None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:21:30.667933 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-b8824b61-2c8c-4f6e-b98d-a65c612a5d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:21:30.687452 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3dc047-a3ac-4f7f-9244-bca6157247aa None None] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:30.718851 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:30.733639 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e5282c-22fb-42da-8ee5-2f1aafa49258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:30.734605 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e5282c-22fb-42da-8ee5-2f1aafa49258 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:30.735169 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e5282c-22fb-42da-8ee5-2f1aafa49258 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:30.735449 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e5282c-22fb-42da-8ee5-2f1aafa49258 None admin] PATH_INFO: `/v3/projects/d8086440d31c4402a8800ca68927d7e1` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:30.736791 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e5282c-22fb-42da-8ee5-2f1aafa49258 None admin] RBAC: Authorizing `identity:get_project(project_id=d8086440d31c4402a8800ca68927d7e1)` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:30.738412 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e5282c-22fb-42da-8ee5-2f1aafa49258 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:30.738583 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 62/116] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:21:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:21:30.740018 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebad991-13d9-49e6-a3e7-efbd259b4147 None None] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:30.745197 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 55/117] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Jul 25 21:21:30 2022] GET /identity/v3/projects/d8086440d31c4402a8800ca68927d7e1 => generated 298 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:21:30.745333 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebad991-13d9-49e6-a3e7-efbd259b4147 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:30.745333 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebad991-13d9-49e6-a3e7-efbd259b4147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:30.745473 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e5282c-22fb-42da-8ee5-2f1aafa49258 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:30.766149 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.auth.core [None req-5ebad991-13d9-49e6-a3e7-efbd259b4147 None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:21:30.767389 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-5ebad991-13d9-49e6-a3e7-efbd259b4147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:21:30.841960 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:30.842154 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 63/118] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:21:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:21:30.846922 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b614ba4d-6f7d-422c-839a-13caa891dd60 None None] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:30.847754 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b614ba4d-6f7d-422c-839a-13caa891dd60 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:30.848227 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b614ba4d-6f7d-422c-839a-13caa891dd60 None None] PATH_INFO: `/` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:30.850605 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 64/119] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:21:30 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:21:30.855075 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e5282c-22fb-42da-8ee5-2f1aafa49258 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:30.856940 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b614ba4d-6f7d-422c-839a-13caa891dd60 None None] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:30.890587 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cc160a-f2f3-4ad0-9127-d37ba9dca992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:30.891351 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cc160a-f2f3-4ad0-9127-d37ba9dca992 None admin] REQUEST_METHOD: `PUT` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:30.891808 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cc160a-f2f3-4ad0-9127-d37ba9dca992 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:30.891918 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cc160a-f2f3-4ad0-9127-d37ba9dca992 None admin] PATH_INFO: `/v3/projects/d8086440d31c4402a8800ca68927d7e1/users/1e6cadb2f0fe422088a106e6a578b2f7/roles/216a86497a3a4593ba08730ea8697df3` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:30.894071 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cc160a-f2f3-4ad0-9127-d37ba9dca992 None admin] RBAC: Authorizing `identity:create_grant(project_id=d8086440d31c4402a8800ca68927d7e1, user_id=1e6cadb2f0fe422088a106e6a578b2f7, role_id=216a86497a3a4593ba08730ea8697df3)` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:30.895563 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cc160a-f2f3-4ad0-9127-d37ba9dca992 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:30.921174 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 56/120] 10.222.0.66 () {58 vars in 1439 bytes} [Mon Jul 25 21:21:30 2022] PUT /identity/v3/projects/d8086440d31c4402a8800ca68927d7e1/users/1e6cadb2f0fe422088a106e6a578b2f7/roles/216a86497a3a4593ba08730ea8697df3 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 21:21:30.921174 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cc160a-f2f3-4ad0-9127-d37ba9dca992 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:30.985178 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b614ba4d-6f7d-422c-839a-13caa891dd60 None None] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:31.004627 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:31.030981 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d89e92-307b-443d-a6f5-ae95723834bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:31.031822 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d89e92-307b-443d-a6f5-ae95723834bd None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:31.032104 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d89e92-307b-443d-a6f5-ae95723834bd None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:31.032503 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d89e92-307b-443d-a6f5-ae95723834bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:31.033656 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d89e92-307b-443d-a6f5-ae95723834bd None admin] RBAC: Adding query filter params (role.id=ca991b54c98340d797cf644d4217dca9, scope.project.id=d8086440d31c4402a8800ca68927d7e1, user.id=ddde747b461549108051f8e0a81f50fd) {{(pid=87209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:21:31.034323 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d89e92-307b-443d-a6f5-ae95723834bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:31.036163 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d89e92-307b-443d-a6f5-ae95723834bd None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:31.042955 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 65/121] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Jul 25 21:21:30 2022] GET /identity/v3/role_assignments?user.id=ddde747b461549108051f8e0a81f50fd&scope.project.id=d8086440d31c4402a8800ca68927d7e1&role.id=ca991b54c98340d797cf644d4217dca9 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:21:31.051205 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae2c750-3237-4e48-9891-314939efd009 None None] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:31.051570 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae2c750-3237-4e48-9891-314939efd009 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:31.051965 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae2c750-3237-4e48-9891-314939efd009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:31.074079 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cc160a-f2f3-4ad0-9127-d37ba9dca992 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:31.089608 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.auth.core [None req-9ae2c750-3237-4e48-9891-314939efd009 None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:21:31.091021 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-9ae2c750-3237-4e48-9891-314939efd009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:21:31.120663 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0246aae2-fa93-4f9f-80c0-44c654aa81a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:31.120663 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0246aae2-fa93-4f9f-80c0-44c654aa81a4 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:31.120663 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0246aae2-fa93-4f9f-80c0-44c654aa81a4 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:31.121206 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0246aae2-fa93-4f9f-80c0-44c654aa81a4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:31.138182 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0246aae2-fa93-4f9f-80c0-44c654aa81a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:21:31.148340 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application [None req-0246aae2-fa93-4f9f-80c0-44c654aa81a4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 21:21:31.148340 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:21:31.148340 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:21:31.148340 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:21:31.148340 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:21:31.148340 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:21:31.148340 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:21:31.148340 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:21:31.148340 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:21:31.148340 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:21:31.148340 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:21:31.148340 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:21:31.148340 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:21:31.148340 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:21:31.148340 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:21:31.148340 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:21:31.149270 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:21:31.149270 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:21:31.149270 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:21:31.149270 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:21:31.149270 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:21:31.149270 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:21:31.149270 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:21:31.149270 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:21:31.149270 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:21:31.149270 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:21:31.149270 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:21:31.149270 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application with Lock( Jul 25 21:21:31.149270 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:21:31.149270 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:21:31.149270 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:21:31.149270 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:21:31.150041 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:21:31.150041 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:21:31.150041 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:21:31.150041 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:21:31.150041 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:21:31.150041 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:21:31.150041 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:21:31.150041 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:21:31.150041 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:21:31.150041 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:21:31.150041 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 21:21:31.150041 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Jul 25 21:21:31.150636 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 57/122] 10.222.0.66 () {56 vars in 1114 bytes} [Mon Jul 25 21:21:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:21:31.153028 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0246aae2-fa93-4f9f-80c0-44c654aa81a4 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:31.185483 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:31.233300 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 66/123] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:21:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:21:31.235372 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae2c750-3237-4e48-9891-314939efd009 None None] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:31.357052 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0246aae2-fa93-4f9f-80c0-44c654aa81a4 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:31.425620 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae2c750-3237-4e48-9891-314939efd009 None None] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:31.441824 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09de4b99-8c2c-4d50-80ce-edef9d422e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:31.442507 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de4b99-8c2c-4d50-80ce-edef9d422e89 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:31.442790 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de4b99-8c2c-4d50-80ce-edef9d422e89 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:31.443066 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de4b99-8c2c-4d50-80ce-edef9d422e89 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:31.460794 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f260e79-0ac6-4e6b-a3a1-70843687011f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:31.461471 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f260e79-0ac6-4e6b-a3a1-70843687011f None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:31.461757 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f260e79-0ac6-4e6b-a3a1-70843687011f None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:31.462041 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f260e79-0ac6-4e6b-a3a1-70843687011f None admin] PATH_INFO: `/v3/roles` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:31.462766 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f260e79-0ac6-4e6b-a3a1-70843687011f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:21:31.463069 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f260e79-0ac6-4e6b-a3a1-70843687011f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:31.464494 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f260e79-0ac6-4e6b-a3a1-70843687011f None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:31.471004 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09de4b99-8c2c-4d50-80ce-edef9d422e89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:21:31.476762 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application [None req-09de4b99-8c2c-4d50-80ce-edef9d422e89 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 21:21:31.476762 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:21:31.476762 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:21:31.476762 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:21:31.476762 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:21:31.476762 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:21:31.476762 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:21:31.476762 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:21:31.476762 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:21:31.476762 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:21:31.476762 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:21:31.476762 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:21:31.476762 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:21:31.476762 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:21:31.476762 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:21:31.476762 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:21:31.477667 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:21:31.477667 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:21:31.477667 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:21:31.477667 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:21:31.477667 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:21:31.477667 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:21:31.477667 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:21:31.477667 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:21:31.477667 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:21:31.477667 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:21:31.477667 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:21:31.477667 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application with Lock( Jul 25 21:21:31.477667 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:21:31.477667 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:21:31.477667 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:21:31.477667 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:21:31.478433 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:21:31.478433 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:21:31.478433 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:21:31.478433 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:21:31.478433 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:21:31.478433 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:21:31.478433 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:21:31.478433 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:21:31.478433 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:21:31.478433 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:21:31.478433 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 21:21:31.478433 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Jul 25 21:21:31.479010 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 67/124] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Jul 25 21:21:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:21:31.479010 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f260e79-0ac6-4e6b-a3a1-70843687011f None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:31.479769 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:31.490375 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 58/125] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Jul 25 21:21:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:21:31.491087 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09de4b99-8c2c-4d50-80ce-edef9d422e89 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:31.599197 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f260e79-0ac6-4e6b-a3a1-70843687011f None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:31.635075 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32089476-1fa7-4a79-80a6-8329e197cb26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:31.635755 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32089476-1fa7-4a79-80a6-8329e197cb26 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:31.636175 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32089476-1fa7-4a79-80a6-8329e197cb26 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:31.636452 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32089476-1fa7-4a79-80a6-8329e197cb26 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:31.647676 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32089476-1fa7-4a79-80a6-8329e197cb26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:21:31.653276 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application [None req-32089476-1fa7-4a79-80a6-8329e197cb26 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 21:21:31.653276 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:21:31.653276 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:21:31.653276 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:21:31.653276 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:21:31.653276 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:21:31.653276 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:21:31.653276 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:21:31.653276 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:21:31.653276 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:21:31.653276 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:21:31.653276 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:21:31.653276 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:21:31.653276 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:21:31.653276 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:21:31.653276 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:21:31.655243 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:21:31.655243 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:21:31.655243 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:21:31.655243 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:21:31.655243 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:21:31.655243 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:21:31.655243 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:21:31.655243 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:21:31.655243 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:21:31.655243 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:21:31.655243 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:21:31.655243 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application with Lock( Jul 25 21:21:31.655243 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:21:31.655243 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:21:31.655243 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:21:31.655243 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:21:31.657209 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:21:31.657209 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:21:31.657209 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:21:31.657209 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:21:31.657209 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:21:31.657209 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:21:31.657209 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:21:31.657209 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:21:31.657209 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:21:31.657209 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:21:31.657209 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 21:21:31.657209 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Jul 25 21:21:31.657209 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 68/126] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Jul 25 21:21:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:21:31.657209 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32089476-1fa7-4a79-80a6-8329e197cb26 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:31.690789 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:31.705992 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:31.739969 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09de4b99-8c2c-4d50-80ce-edef9d422e89 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:31.777855 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4a15e7-3a18-4e37-95b1-6778bb10dfc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:31.779098 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4a15e7-3a18-4e37-95b1-6778bb10dfc3 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:31.779474 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4a15e7-3a18-4e37-95b1-6778bb10dfc3 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:31.780141 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4a15e7-3a18-4e37-95b1-6778bb10dfc3 None admin] PATH_INFO: `/v3/users/598778bbdcb54a8eac7f2dcc1a1357d8` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:31.781643 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4a15e7-3a18-4e37-95b1-6778bb10dfc3 None admin] RBAC: Authorizing `identity:get_user(user_id=598778bbdcb54a8eac7f2dcc1a1357d8)` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:31.783667 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4a15e7-3a18-4e37-95b1-6778bb10dfc3 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:31.785439 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 59/127] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Jul 25 21:21:31 2022] GET /identity/v3/users/598778bbdcb54a8eac7f2dcc1a1357d8 => generated 275 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:21:31.786290 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4a15e7-3a18-4e37-95b1-6778bb10dfc3 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:31.814958 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32089476-1fa7-4a79-80a6-8329e197cb26 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:31.868930 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc59769-fd0d-4d3f-b998-6c21c8879e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:31.869756 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc59769-fd0d-4d3f-b998-6c21c8879e64 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:31.870270 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc59769-fd0d-4d3f-b998-6c21c8879e64 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:31.870632 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc59769-fd0d-4d3f-b998-6c21c8879e64 None admin] PATH_INFO: `/v3/roles` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:31.871489 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc59769-fd0d-4d3f-b998-6c21c8879e64 None admin] RBAC: Adding query filter params (name=member) {{(pid=87209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:21:31.871883 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc59769-fd0d-4d3f-b998-6c21c8879e64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:31.873427 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc59769-fd0d-4d3f-b998-6c21c8879e64 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:31.883128 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 69/128] 10.222.0.66 () {56 vars in 1101 bytes} [Mon Jul 25 21:21:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:21:31.883940 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc59769-fd0d-4d3f-b998-6c21c8879e64 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:31.963194 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4a15e7-3a18-4e37-95b1-6778bb10dfc3 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:32.013448 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:32.023093 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc59769-fd0d-4d3f-b998-6c21c8879e64 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:32.062466 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7b723d-6f69-4739-8374-958f2418cda7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:32.063992 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7b723d-6f69-4739-8374-958f2418cda7 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:32.064781 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2df613-bb61-49d8-b5f1-39d56cba86c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:32.065634 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2df613-bb61-49d8-b5f1-39d56cba86c8 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:32.066105 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7b723d-6f69-4739-8374-958f2418cda7 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:32.066525 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7b723d-6f69-4739-8374-958f2418cda7 None admin] PATH_INFO: `/v3/projects/d8086440d31c4402a8800ca68927d7e1` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:32.066938 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2df613-bb61-49d8-b5f1-39d56cba86c8 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:32.067867 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2df613-bb61-49d8-b5f1-39d56cba86c8 None admin] PATH_INFO: `/v3/roles` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:32.068718 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2df613-bb61-49d8-b5f1-39d56cba86c8 None admin] RBAC: Adding query filter params (name=member) {{(pid=87210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:21:32.069507 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7b723d-6f69-4739-8374-958f2418cda7 None admin] RBAC: Authorizing `identity:get_project(project_id=d8086440d31c4402a8800ca68927d7e1)` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:32.069963 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2df613-bb61-49d8-b5f1-39d56cba86c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:32.071992 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2df613-bb61-49d8-b5f1-39d56cba86c8 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:32.073237 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7b723d-6f69-4739-8374-958f2418cda7 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:32.075051 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 70/129] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Jul 25 21:21:31 2022] GET /identity/v3/projects/d8086440d31c4402a8800ca68927d7e1 => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:21:32.078863 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7b723d-6f69-4739-8374-958f2418cda7 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:32.092700 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 60/130] 10.222.0.66 () {56 vars in 1101 bytes} [Mon Jul 25 21:21:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:21:32.097223 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2df613-bb61-49d8-b5f1-39d56cba86c8 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:32.101602 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:32.293270 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7b723d-6f69-4739-8374-958f2418cda7 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:32.306126 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2df613-bb61-49d8-b5f1-39d56cba86c8 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:32.344421 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df4cf13-baee-474a-9e52-d42a2145ab3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:32.345159 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df4cf13-baee-474a-9e52-d42a2145ab3b None admin] REQUEST_METHOD: `PUT` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:32.345488 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df4cf13-baee-474a-9e52-d42a2145ab3b None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:32.345787 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df4cf13-baee-474a-9e52-d42a2145ab3b None admin] PATH_INFO: `/v3/projects/d8086440d31c4402a8800ca68927d7e1/users/598778bbdcb54a8eac7f2dcc1a1357d8/roles/f910595b432f450eb4b382e0c99cf932` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:32.348780 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df4cf13-baee-474a-9e52-d42a2145ab3b None admin] RBAC: Authorizing `identity:create_grant(project_id=d8086440d31c4402a8800ca68927d7e1, user_id=598778bbdcb54a8eac7f2dcc1a1357d8, role_id=f910595b432f450eb4b382e0c99cf932)` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:32.350473 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df4cf13-baee-474a-9e52-d42a2145ab3b None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:32.368656 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 61/131] 10.222.0.66 () {58 vars in 1439 bytes} [Mon Jul 25 21:21:32 2022] PUT /identity/v3/projects/d8086440d31c4402a8800ca68927d7e1/users/598778bbdcb54a8eac7f2dcc1a1357d8/roles/f910595b432f450eb4b382e0c99cf932 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 21:21:32.369529 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df4cf13-baee-474a-9e52-d42a2145ab3b None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:32.392153 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd6805b-7b00-4e4d-be8b-aec3a82f35f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:32.392899 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd6805b-7b00-4e4d-be8b-aec3a82f35f3 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:32.393205 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd6805b-7b00-4e4d-be8b-aec3a82f35f3 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:32.393484 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd6805b-7b00-4e4d-be8b-aec3a82f35f3 None admin] PATH_INFO: `/v3/users/598778bbdcb54a8eac7f2dcc1a1357d8` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:32.394690 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd6805b-7b00-4e4d-be8b-aec3a82f35f3 None admin] RBAC: Authorizing `identity:get_user(user_id=598778bbdcb54a8eac7f2dcc1a1357d8)` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:32.396185 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd6805b-7b00-4e4d-be8b-aec3a82f35f3 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:32.401926 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 71/132] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Jul 25 21:21:32 2022] GET /identity/v3/users/598778bbdcb54a8eac7f2dcc1a1357d8 => generated 275 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:21:32.407496 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd6805b-7b00-4e4d-be8b-aec3a82f35f3 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:32.461453 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:32.512994 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:32.516910 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df4cf13-baee-474a-9e52-d42a2145ab3b None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:32.566455 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e408de04-8e3d-4ba9-98e7-0cf99dc2d19f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:32.567380 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e408de04-8e3d-4ba9-98e7-0cf99dc2d19f None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:32.567666 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e408de04-8e3d-4ba9-98e7-0cf99dc2d19f None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:32.567939 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e408de04-8e3d-4ba9-98e7-0cf99dc2d19f None admin] PATH_INFO: `/v3/users/598778bbdcb54a8eac7f2dcc1a1357d8` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:32.571097 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e408de04-8e3d-4ba9-98e7-0cf99dc2d19f None admin] RBAC: Authorizing `identity:get_user(user_id=598778bbdcb54a8eac7f2dcc1a1357d8)` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:32.573172 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e408de04-8e3d-4ba9-98e7-0cf99dc2d19f None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:32.575541 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 62/133] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Jul 25 21:21:32 2022] GET /identity/v3/users/598778bbdcb54a8eac7f2dcc1a1357d8 => generated 275 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:21:32.588355 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e408de04-8e3d-4ba9-98e7-0cf99dc2d19f None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:32.732010 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd6805b-7b00-4e4d-be8b-aec3a82f35f3 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:32.772580 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53421f5-6060-4fa6-a959-627acc1df2e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:32.773481 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53421f5-6060-4fa6-a959-627acc1df2e8 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:32.773807 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53421f5-6060-4fa6-a959-627acc1df2e8 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:32.774127 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53421f5-6060-4fa6-a959-627acc1df2e8 None admin] PATH_INFO: `/v3/projects/6b3d6a0f3788448cbaba3c0da736a4a8` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:32.775473 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53421f5-6060-4fa6-a959-627acc1df2e8 None admin] RBAC: Authorizing `identity:get_project(project_id=6b3d6a0f3788448cbaba3c0da736a4a8)` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:32.777506 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53421f5-6060-4fa6-a959-627acc1df2e8 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:32.779488 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 72/134] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Jul 25 21:21:32 2022] GET /identity/v3/projects/6b3d6a0f3788448cbaba3c0da736a4a8 => generated 312 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:21:32.786842 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53421f5-6060-4fa6-a959-627acc1df2e8 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:32.838563 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e408de04-8e3d-4ba9-98e7-0cf99dc2d19f None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:32.897441 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:32.908846 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c00def-8a3e-4fac-bb82-7095abf8fe9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:32.909541 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c00def-8a3e-4fac-bb82-7095abf8fe9a None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:32.909821 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c00def-8a3e-4fac-bb82-7095abf8fe9a None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:32.910094 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c00def-8a3e-4fac-bb82-7095abf8fe9a None admin] PATH_INFO: `/v3/projects/d8086440d31c4402a8800ca68927d7e1` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:32.911916 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c00def-8a3e-4fac-bb82-7095abf8fe9a None admin] RBAC: Authorizing `identity:get_project(project_id=d8086440d31c4402a8800ca68927d7e1)` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:32.913399 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c00def-8a3e-4fac-bb82-7095abf8fe9a None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:32.915674 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 63/135] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Jul 25 21:21:32 2022] GET /identity/v3/projects/d8086440d31c4402a8800ca68927d7e1 => generated 298 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:21:32.921817 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c00def-8a3e-4fac-bb82-7095abf8fe9a None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:32.939923 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:32.946667 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53421f5-6060-4fa6-a959-627acc1df2e8 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:33.013606 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e70ed8-6e74-4f5a-b96a-fa9df32cc132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:33.014573 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e70ed8-6e74-4f5a-b96a-fa9df32cc132 None admin] REQUEST_METHOD: `PUT` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:33.014990 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e70ed8-6e74-4f5a-b96a-fa9df32cc132 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:33.015412 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e70ed8-6e74-4f5a-b96a-fa9df32cc132 None admin] PATH_INFO: `/v3/projects/6b3d6a0f3788448cbaba3c0da736a4a8/users/598778bbdcb54a8eac7f2dcc1a1357d8/roles/faec70ea0ba040efa587f542f054e49e` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:33.017595 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e70ed8-6e74-4f5a-b96a-fa9df32cc132 None admin] RBAC: Authorizing `identity:create_grant(project_id=6b3d6a0f3788448cbaba3c0da736a4a8, user_id=598778bbdcb54a8eac7f2dcc1a1357d8, role_id=faec70ea0ba040efa587f542f054e49e)` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:33.019279 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e70ed8-6e74-4f5a-b96a-fa9df32cc132 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:33.045913 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 73/136] 10.222.0.66 () {58 vars in 1439 bytes} [Mon Jul 25 21:21:32 2022] PUT /identity/v3/projects/6b3d6a0f3788448cbaba3c0da736a4a8/users/598778bbdcb54a8eac7f2dcc1a1357d8/roles/faec70ea0ba040efa587f542f054e49e => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 21:21:33.048016 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd53af8b-bc9b-431b-b965-da82226e3652 None None] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:33.048545 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd53af8b-bc9b-431b-b965-da82226e3652 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:33.049204 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd53af8b-bc9b-431b-b965-da82226e3652 None None] PATH_INFO: `/` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:33.051193 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 74/137] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:21:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:21:33.057335 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a617e0-5d7e-42c1-9a91-20c0b1839585 None None] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:33.057942 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a617e0-5d7e-42c1-9a91-20c0b1839585 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:33.058443 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a617e0-5d7e-42c1-9a91-20c0b1839585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:33.098275 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.auth.core [None req-50a617e0-5d7e-42c1-9a91-20c0b1839585 None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:21:33.099516 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-50a617e0-5d7e-42c1-9a91-20c0b1839585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:21:33.102544 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c00def-8a3e-4fac-bb82-7095abf8fe9a None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:33.142808 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676a712f-a784-4120-9c0a-0a63682bd150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:33.146117 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676a712f-a784-4120-9c0a-0a63682bd150 None admin] REQUEST_METHOD: `PUT` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:33.146769 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676a712f-a784-4120-9c0a-0a63682bd150 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:33.148373 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676a712f-a784-4120-9c0a-0a63682bd150 None admin] PATH_INFO: `/v3/projects/d8086440d31c4402a8800ca68927d7e1/users/598778bbdcb54a8eac7f2dcc1a1357d8/roles/faec70ea0ba040efa587f542f054e49e` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:33.152226 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676a712f-a784-4120-9c0a-0a63682bd150 None admin] RBAC: Authorizing `identity:create_grant(project_id=d8086440d31c4402a8800ca68927d7e1, user_id=598778bbdcb54a8eac7f2dcc1a1357d8, role_id=faec70ea0ba040efa587f542f054e49e)` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:33.154162 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676a712f-a784-4120-9c0a-0a63682bd150 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:33.185409 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 64/138] 10.222.0.66 () {58 vars in 1439 bytes} [Mon Jul 25 21:21:32 2022] PUT /identity/v3/projects/d8086440d31c4402a8800ca68927d7e1/users/598778bbdcb54a8eac7f2dcc1a1357d8/roles/faec70ea0ba040efa587f542f054e49e => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 21:21:33.223667 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 75/139] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:21:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:21:33.287663 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676a712f-a784-4120-9c0a-0a63682bd150 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:33.361590 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:33.409241 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676a712f-a784-4120-9c0a-0a63682bd150 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:33.452341 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e830e0-59a9-4bd7-9a96-7813175d21b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:33.453475 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e830e0-59a9-4bd7-9a96-7813175d21b9 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:33.453960 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e830e0-59a9-4bd7-9a96-7813175d21b9 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:33.454422 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e830e0-59a9-4bd7-9a96-7813175d21b9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:33.456235 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e830e0-59a9-4bd7-9a96-7813175d21b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:33.458068 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e830e0-59a9-4bd7-9a96-7813175d21b9 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:33.459990 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 65/140] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 25 21:21:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:21:33.465663 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a617e0-5d7e-42c1-9a91-20c0b1839585 None None] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:33.572719 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:33.592920 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a617e0-5d7e-42c1-9a91-20c0b1839585 None None] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:33.634707 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e221387-1866-4756-8532-0ae1bf575fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:33.635263 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e221387-1866-4756-8532-0ae1bf575fb6 None admin] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:33.635539 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e221387-1866-4756-8532-0ae1bf575fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:33.635806 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e221387-1866-4756-8532-0ae1bf575fb6 None admin] PATH_INFO: `/v3/users` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:33.636507 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e221387-1866-4756-8532-0ae1bf575fb6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:33.637994 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e221387-1866-4756-8532-0ae1bf575fb6 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:33.662533 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 76/141] 10.222.0.66 () {60 vars in 1132 bytes} [Mon Jul 25 21:21:33 2022] POST /identity/v3/users => generated 283 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 21:21:33.771727 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f823a5-d113-4994-b958-e4578b4b55a1 None None] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:33.772126 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f823a5-d113-4994-b958-e4578b4b55a1 None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:33.772433 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f823a5-d113-4994-b958-e4578b4b55a1 None None] PATH_INFO: `/` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:33.774011 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 66/142] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:21:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 21:21:33.779591 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40014178-d0b1-4755-90ce-32e9dd6aebc6 None None] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:33.779878 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40014178-d0b1-4755-90ce-32e9dd6aebc6 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:33.780155 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40014178-d0b1-4755-90ce-32e9dd6aebc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:33.807062 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.auth.core [None req-40014178-d0b1-4755-90ce-32e9dd6aebc6 None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:21:33.808348 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-40014178-d0b1-4755-90ce-32e9dd6aebc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:21:33.898101 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 77/143] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:21:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:21:33.930686 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f823a5-d113-4994-b958-e4578b4b55a1 None None] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:34.078870 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f823a5-d113-4994-b958-e4578b4b55a1 None None] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:34.120010 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:34.134092 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307bec45-dca7-4877-b831-51b52e21529b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:34.134754 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307bec45-dca7-4877-b831-51b52e21529b None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:34.135041 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307bec45-dca7-4877-b831-51b52e21529b None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:34.135319 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307bec45-dca7-4877-b831-51b52e21529b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:34.152602 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307bec45-dca7-4877-b831-51b52e21529b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:21:34.158088 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application [None req-307bec45-dca7-4877-b831-51b52e21529b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 21:21:34.158088 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:21:34.158088 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:21:34.158088 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:21:34.158088 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:21:34.158088 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:21:34.158088 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:21:34.158088 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:21:34.158088 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:21:34.158088 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:21:34.158088 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:21:34.158088 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:21:34.158088 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:21:34.158088 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:21:34.158088 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:21:34.158088 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:21:34.159103 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:21:34.159103 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:21:34.159103 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:21:34.159103 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:21:34.159103 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:21:34.159103 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:21:34.159103 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:21:34.159103 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:21:34.159103 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:21:34.159103 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:21:34.159103 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:21:34.159103 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application with Lock( Jul 25 21:21:34.159103 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:21:34.159103 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:21:34.159103 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:21:34.159103 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:21:34.159961 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:21:34.159961 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:21:34.159961 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:21:34.159961 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:21:34.159961 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:21:34.159961 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:21:34.159961 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:21:34.159961 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:21:34.159961 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:21:34.159961 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:21:34.159961 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 21:21:34.159961 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Jul 25 21:21:34.159961 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 67/144] 10.222.0.66 () {56 vars in 1096 bytes} [Mon Jul 25 21:21:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:21:34.170249 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40014178-d0b1-4755-90ce-32e9dd6aebc6 None None] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:34.275183 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:34.319874 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40014178-d0b1-4755-90ce-32e9dd6aebc6 None None] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:34.333263 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a16d7a0-c02c-4570-9a48-d6698c4e8cb1 None None] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:34.334206 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a16d7a0-c02c-4570-9a48-d6698c4e8cb1 None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:34.335990 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a16d7a0-c02c-4570-9a48-d6698c4e8cb1 None None] PATH_INFO: `/` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:34.337596 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 68/145] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:21:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:21:34.347044 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cd13d5-cc60-45d7-bba3-04c5e594a182 None None] REQUEST_METHOD: `POST` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:34.347614 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cd13d5-cc60-45d7-bba3-04c5e594a182 None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:34.348079 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cd13d5-cc60-45d7-bba3-04c5e594a182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:34.372767 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e22f47-7888-40f7-aa74-91958911bc80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:34.373664 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e22f47-7888-40f7-aa74-91958911bc80 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:34.374061 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e22f47-7888-40f7-aa74-91958911bc80 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:34.374484 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e22f47-7888-40f7-aa74-91958911bc80 None admin] PATH_INFO: `/v3/roles` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:34.375322 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e22f47-7888-40f7-aa74-91958911bc80 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:21:34.375744 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e22f47-7888-40f7-aa74-91958911bc80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:34.380279 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e22f47-7888-40f7-aa74-91958911bc80 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:34.386236 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.auth.core [None req-23cd13d5-cc60-45d7-bba3-04c5e594a182 None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:21:34.388806 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.fernet_utils [None req-23cd13d5-cc60-45d7-bba3-04c5e594a182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:21:34.399387 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 78/146] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Jul 25 21:21:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:21:34.405847 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e22f47-7888-40f7-aa74-91958911bc80 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:34.524460 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 69/147] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:21:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:21:34.564577 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cd13d5-cc60-45d7-bba3-04c5e594a182 None None] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:34.574898 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e22f47-7888-40f7-aa74-91958911bc80 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:34.646095 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85c1018-ac8a-4387-b3bd-f5d0de53508a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:34.647030 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85c1018-ac8a-4387-b3bd-f5d0de53508a None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:34.647444 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85c1018-ac8a-4387-b3bd-f5d0de53508a None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:34.648560 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85c1018-ac8a-4387-b3bd-f5d0de53508a None admin] PATH_INFO: `/v3/users/1e6cadb2f0fe422088a106e6a578b2f7` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:34.650146 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85c1018-ac8a-4387-b3bd-f5d0de53508a None admin] RBAC: Authorizing `identity:get_user(user_id=1e6cadb2f0fe422088a106e6a578b2f7)` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:34.652528 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85c1018-ac8a-4387-b3bd-f5d0de53508a None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:34.654483 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 79/148] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Jul 25 21:21:34 2022] GET /identity/v3/users/1e6cadb2f0fe422088a106e6a578b2f7 => generated 247 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:21:34.660558 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85c1018-ac8a-4387-b3bd-f5d0de53508a None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:34.666319 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:34.751201 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cd13d5-cc60-45d7-bba3-04c5e594a182 None None] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:34.784680 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:34.823746 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f633a3b4-f09a-4ba8-b08a-585d8931ae40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:34.824411 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f633a3b4-f09a-4ba8-b08a-585d8931ae40 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:34.824688 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f633a3b4-f09a-4ba8-b08a-585d8931ae40 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:34.824958 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f633a3b4-f09a-4ba8-b08a-585d8931ae40 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:34.844446 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f633a3b4-f09a-4ba8-b08a-585d8931ae40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:21:34.845917 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85c1018-ac8a-4387-b3bd-f5d0de53508a None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:34.850071 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application [None req-f633a3b4-f09a-4ba8-b08a-585d8931ae40 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 21:21:34.850071 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:21:34.850071 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:21:34.850071 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:21:34.850071 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:21:34.850071 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:21:34.850071 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:21:34.850071 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:21:34.850071 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:21:34.850071 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:21:34.850071 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:21:34.850071 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:21:34.850071 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:21:34.850071 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:21:34.850071 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:21:34.850071 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:21:34.851162 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:21:34.851162 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:21:34.851162 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:21:34.851162 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:21:34.851162 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:21:34.851162 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:21:34.851162 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:21:34.851162 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:21:34.851162 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:21:34.851162 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:21:34.851162 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:21:34.851162 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application with Lock( Jul 25 21:21:34.851162 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:21:34.851162 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:21:34.851162 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:21:34.851162 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:21:34.852116 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:21:34.852116 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:21:34.852116 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:21:34.852116 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:21:34.852116 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:21:34.852116 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:21:34.852116 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:21:34.852116 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:21:34.852116 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:21:34.852116 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:21:34.852116 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 21:21:34.852116 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Jul 25 21:21:34.854994 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 70/149] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Jul 25 21:21:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 21:21:34.864482 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f633a3b4-f09a-4ba8-b08a-585d8931ae40 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:34.914796 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3617c8b3-3ae5-4f57-8a36-ba560d2ad1a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:34.915996 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3617c8b3-3ae5-4f57-8a36-ba560d2ad1a9 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:34.916597 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3617c8b3-3ae5-4f57-8a36-ba560d2ad1a9 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:34.917519 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3617c8b3-3ae5-4f57-8a36-ba560d2ad1a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:35.054384 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3617c8b3-3ae5-4f57-8a36-ba560d2ad1a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:35.055887 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3617c8b3-3ae5-4f57-8a36-ba560d2ad1a9 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:35.058691 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:35.060841 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f633a3b4-f09a-4ba8-b08a-585d8931ae40 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:35.125584 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7450d6-6c90-42f5-a6f2-5e59af0319e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:35.126234 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7450d6-6c90-42f5-a6f2-5e59af0319e5 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:35.126515 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7450d6-6c90-42f5-a6f2-5e59af0319e5 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:35.126850 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7450d6-6c90-42f5-a6f2-5e59af0319e5 None admin] PATH_INFO: `/v3/roles` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:35.127575 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7450d6-6c90-42f5-a6f2-5e59af0319e5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:21:35.127881 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7450d6-6c90-42f5-a6f2-5e59af0319e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:35.129317 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7450d6-6c90-42f5-a6f2-5e59af0319e5 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:35.159602 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 71/150] 10.222.0.66 () {56 vars in 1101 bytes} [Mon Jul 25 21:21:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:21:35.165900 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7450d6-6c90-42f5-a6f2-5e59af0319e5 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:35.245818 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:35.264725 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 80/151] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Jul 25 21:21:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 605 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 21:21:35.271178 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3617c8b3-3ae5-4f57-8a36-ba560d2ad1a9 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:35.389029 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7450d6-6c90-42f5-a6f2-5e59af0319e5 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:35.465877 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41ffcc2-dd3e-4e26-898e-2b3002c3b2a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:35.466868 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41ffcc2-dd3e-4e26-898e-2b3002c3b2a6 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:35.467326 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41ffcc2-dd3e-4e26-898e-2b3002c3b2a6 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:35.467775 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41ffcc2-dd3e-4e26-898e-2b3002c3b2a6 None admin] PATH_INFO: `/v3/users/ddde747b461549108051f8e0a81f50fd` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:35.468199 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3617c8b3-3ae5-4f57-8a36-ba560d2ad1a9 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:35.469296 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41ffcc2-dd3e-4e26-898e-2b3002c3b2a6 None admin] RBAC: Authorizing `identity:get_user(user_id=ddde747b461549108051f8e0a81f50fd)` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:35.471024 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41ffcc2-dd3e-4e26-898e-2b3002c3b2a6 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:35.471149 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:35.472846 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 72/152] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Jul 25 21:21:35 2022] GET /identity/v3/users/ddde747b461549108051f8e0a81f50fd => generated 289 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:21:35.478747 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41ffcc2-dd3e-4e26-898e-2b3002c3b2a6 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:35.516159 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae29162-821c-4674-8b2d-82acc17b5eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:35.517148 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae29162-821c-4674-8b2d-82acc17b5eb9 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:35.517714 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae29162-821c-4674-8b2d-82acc17b5eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:35.518273 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae29162-821c-4674-8b2d-82acc17b5eb9 None admin] PATH_INFO: `/v3/projects/d8086440d31c4402a8800ca68927d7e1` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:35.519828 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae29162-821c-4674-8b2d-82acc17b5eb9 None admin] RBAC: Authorizing `identity:get_project(project_id=d8086440d31c4402a8800ca68927d7e1)` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:35.521968 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae29162-821c-4674-8b2d-82acc17b5eb9 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:35.523842 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 81/153] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Jul 25 21:21:35 2022] GET /identity/v3/projects/d8086440d31c4402a8800ca68927d7e1 => generated 298 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:21:35.530482 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae29162-821c-4674-8b2d-82acc17b5eb9 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:35.716341 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae29162-821c-4674-8b2d-82acc17b5eb9 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:35.732835 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41ffcc2-dd3e-4e26-898e-2b3002c3b2a6 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:35.745445 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:35.774525 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e9103c-ce27-49c9-b296-53c4f808cdb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:35.775559 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e9103c-ce27-49c9-b296-53c4f808cdb8 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:35.776428 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e9103c-ce27-49c9-b296-53c4f808cdb8 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:35.776933 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e9103c-ce27-49c9-b296-53c4f808cdb8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:35.778080 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e9103c-ce27-49c9-b296-53c4f808cdb8 None admin] RBAC: Adding query filter params (role.id=216a86497a3a4593ba08730ea8697df3, scope.project.id=d8086440d31c4402a8800ca68927d7e1, user.id=1e6cadb2f0fe422088a106e6a578b2f7) {{(pid=87209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:21:35.778664 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e9103c-ce27-49c9-b296-53c4f808cdb8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:35.780364 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e9103c-ce27-49c9-b296-53c4f808cdb8 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:35.793012 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 82/154] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Jul 25 21:21:35 2022] GET /identity/v3/role_assignments?user.id=1e6cadb2f0fe422088a106e6a578b2f7&scope.project.id=d8086440d31c4402a8800ca68927d7e1&role.id=216a86497a3a4593ba08730ea8697df3 => generated 608 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:21:35.811342 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0081adc3-4921-464e-a222-5c21d1762219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:35.812027 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0081adc3-4921-464e-a222-5c21d1762219 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:35.812310 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0081adc3-4921-464e-a222-5c21d1762219 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:35.812586 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0081adc3-4921-464e-a222-5c21d1762219 None admin] PATH_INFO: `/v3/projects/d8086440d31c4402a8800ca68927d7e1` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:35.817648 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0081adc3-4921-464e-a222-5c21d1762219 None admin] RBAC: Authorizing `identity:get_project(project_id=d8086440d31c4402a8800ca68927d7e1)` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:35.819200 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0081adc3-4921-464e-a222-5c21d1762219 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:35.821007 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 73/155] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Jul 25 21:21:35 2022] GET /identity/v3/projects/d8086440d31c4402a8800ca68927d7e1 => generated 298 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:21:35.827126 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e9103c-ce27-49c9-b296-53c4f808cdb8 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:35.923508 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:36.067489 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e9103c-ce27-49c9-b296-53c4f808cdb8 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:36.151991 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c350e9c4-6e0e-4789-a7a7-3aa9adf1734c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:36.152708 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c350e9c4-6e0e-4789-a7a7-3aa9adf1734c None admin] REQUEST_METHOD: `PUT` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:36.152990 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c350e9c4-6e0e-4789-a7a7-3aa9adf1734c None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:36.153313 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c350e9c4-6e0e-4789-a7a7-3aa9adf1734c None admin] PATH_INFO: `/v3/projects/d8086440d31c4402a8800ca68927d7e1/users/ddde747b461549108051f8e0a81f50fd/roles/ca991b54c98340d797cf644d4217dca9` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:36.158564 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c350e9c4-6e0e-4789-a7a7-3aa9adf1734c None admin] RBAC: Authorizing `identity:create_grant(project_id=d8086440d31c4402a8800ca68927d7e1, user_id=ddde747b461549108051f8e0a81f50fd, role_id=ca991b54c98340d797cf644d4217dca9)` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:36.160110 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c350e9c4-6e0e-4789-a7a7-3aa9adf1734c None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:36.183643 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 83/156] 10.222.0.66 () {58 vars in 1439 bytes} [Mon Jul 25 21:21:35 2022] PUT /identity/v3/projects/d8086440d31c4402a8800ca68927d7e1/users/ddde747b461549108051f8e0a81f50fd/roles/ca991b54c98340d797cf644d4217dca9 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 21:21:36.491648 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312cf0d4-407a-4086-afd3-04ace12a798b None None] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:36.492167 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312cf0d4-407a-4086-afd3-04ace12a798b None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:36.492167 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312cf0d4-407a-4086-afd3-04ace12a798b None None] PATH_INFO: `/` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:36.493823 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 74/157] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:21:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:21:36.499582 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7010aa40-40ec-49b5-8135-0ffdebcb49e3 None None] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:36.500024 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7010aa40-40ec-49b5-8135-0ffdebcb49e3 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:36.500215 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7010aa40-40ec-49b5-8135-0ffdebcb49e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:36.526325 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.auth.core [None req-7010aa40-40ec-49b5-8135-0ffdebcb49e3 None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:21:36.527636 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-7010aa40-40ec-49b5-8135-0ffdebcb49e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:21:36.630095 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 84/158] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:21:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:21:36.676176 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312cf0d4-407a-4086-afd3-04ace12a798b None None] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:36.799485 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312cf0d4-407a-4086-afd3-04ace12a798b None None] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:36.839853 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c649b0-3351-440d-9e86-2b2d44cb46c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:36.840505 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c649b0-3351-440d-9e86-2b2d44cb46c6 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:36.840787 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c649b0-3351-440d-9e86-2b2d44cb46c6 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:36.841061 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c649b0-3351-440d-9e86-2b2d44cb46c6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:36.858051 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c649b0-3351-440d-9e86-2b2d44cb46c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:21:36.863858 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application [None req-c4c649b0-3351-440d-9e86-2b2d44cb46c6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 21:21:36.863858 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:21:36.863858 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:21:36.863858 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:21:36.863858 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:21:36.863858 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:21:36.863858 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:21:36.863858 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:21:36.863858 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:21:36.863858 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:21:36.863858 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:21:36.863858 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:21:36.863858 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:21:36.863858 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:21:36.863858 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:21:36.863858 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:21:36.864748 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:21:36.864748 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:21:36.864748 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:21:36.864748 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:21:36.864748 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:21:36.864748 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:21:36.864748 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:21:36.864748 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:21:36.864748 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:21:36.864748 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:21:36.864748 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:21:36.864748 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application with Lock( Jul 25 21:21:36.864748 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:21:36.864748 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:21:36.864748 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:21:36.864748 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:21:36.865597 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:21:36.865597 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:21:36.865597 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:21:36.865597 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:21:36.865597 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:21:36.865597 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:21:36.865597 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:21:36.865597 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:21:36.865597 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:21:36.865597 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:21:36.865597 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 21:21:36.865597 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Jul 25 21:21:36.869479 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 75/159] 10.222.0.66 () {56 vars in 1114 bytes} [Mon Jul 25 21:21:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:21:36.875784 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7010aa40-40ec-49b5-8135-0ffdebcb49e3 None None] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:36.911647 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:36.975462 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d327c8-a2c2-48a9-ab4a-5b6adf57118d None None] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:36.975797 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d327c8-a2c2-48a9-ab4a-5b6adf57118d None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:36.976002 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d327c8-a2c2-48a9-ab4a-5b6adf57118d None None] PATH_INFO: `/` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:36.977702 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 76/160] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:21:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:21:36.987037 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c05d664-7f6b-4302-920e-e92b344ec458 None None] REQUEST_METHOD: `POST` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:36.987406 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c05d664-7f6b-4302-920e-e92b344ec458 None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:36.987714 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c05d664-7f6b-4302-920e-e92b344ec458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:37.037252 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7010aa40-40ec-49b5-8135-0ffdebcb49e3 None None] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:37.042138 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.auth.core [None req-3c05d664-7f6b-4302-920e-e92b344ec458 None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:21:37.043356 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.fernet_utils [None req-3c05d664-7f6b-4302-920e-e92b344ec458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:21:37.113616 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:37.116544 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356bffa3-ab06-422f-9c3d-1ce207769edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:37.117228 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356bffa3-ab06-422f-9c3d-1ce207769edb None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:37.117510 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356bffa3-ab06-422f-9c3d-1ce207769edb None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:37.117785 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356bffa3-ab06-422f-9c3d-1ce207769edb None admin] PATH_INFO: `/v3/roles` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:37.118516 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356bffa3-ab06-422f-9c3d-1ce207769edb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:21:37.118818 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356bffa3-ab06-422f-9c3d-1ce207769edb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:37.120237 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356bffa3-ab06-422f-9c3d-1ce207769edb None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:37.136517 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 85/161] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Jul 25 21:21:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:21:37.142049 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356bffa3-ab06-422f-9c3d-1ce207769edb None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:37.191217 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 77/162] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:21:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:21:37.247547 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c05d664-7f6b-4302-920e-e92b344ec458 None None] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:37.308251 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:37.337142 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356bffa3-ab06-422f-9c3d-1ce207769edb None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:37.403920 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8c1e94-0e21-4c4d-b0bf-09f0da4fc2b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:37.404660 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8c1e94-0e21-4c4d-b0bf-09f0da4fc2b7 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:37.404941 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8c1e94-0e21-4c4d-b0bf-09f0da4fc2b7 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:37.405324 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8c1e94-0e21-4c4d-b0bf-09f0da4fc2b7 None admin] PATH_INFO: `/v3/users/598778bbdcb54a8eac7f2dcc1a1357d8` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:37.407175 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8c1e94-0e21-4c4d-b0bf-09f0da4fc2b7 None admin] RBAC: Authorizing `identity:get_user(user_id=598778bbdcb54a8eac7f2dcc1a1357d8)` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:37.408825 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8c1e94-0e21-4c4d-b0bf-09f0da4fc2b7 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:37.410778 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 86/163] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Jul 25 21:21:37 2022] GET /identity/v3/users/598778bbdcb54a8eac7f2dcc1a1357d8 => generated 275 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:21:37.417546 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072e8f05-76e6-44a8-b0d4-0c656bb8de92 None None] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:37.417832 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072e8f05-76e6-44a8-b0d4-0c656bb8de92 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:37.418112 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072e8f05-76e6-44a8-b0d4-0c656bb8de92 None None] PATH_INFO: `/` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:37.419613 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 87/164] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:21:37 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:21:37.421844 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072e8f05-76e6-44a8-b0d4-0c656bb8de92 None None] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:37.504381 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c05d664-7f6b-4302-920e-e92b344ec458 None None] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:37.582016 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73af244-b9d8-4e99-9199-325220503b63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:37.582689 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73af244-b9d8-4e99-9199-325220503b63 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:37.582973 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73af244-b9d8-4e99-9199-325220503b63 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:37.586488 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73af244-b9d8-4e99-9199-325220503b63 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:37.610980 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73af244-b9d8-4e99-9199-325220503b63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:21:37.616050 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application [None req-b73af244-b9d8-4e99-9199-325220503b63 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 21:21:37.616050 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:21:37.616050 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:21:37.616050 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:21:37.616050 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:21:37.616050 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:21:37.616050 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:21:37.616050 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:21:37.616050 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:21:37.616050 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:21:37.616050 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:21:37.616050 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:21:37.616050 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:21:37.616050 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:21:37.616050 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:21:37.616050 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:21:37.616903 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:21:37.616903 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:21:37.616903 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:21:37.616903 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:21:37.616903 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:21:37.616903 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:21:37.616903 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:21:37.616903 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:21:37.616903 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:21:37.616903 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:21:37.616903 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:21:37.616903 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application with Lock( Jul 25 21:21:37.616903 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:21:37.616903 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:21:37.616903 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:21:37.616903 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:21:37.617695 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:21:37.617695 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:21:37.617695 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:21:37.617695 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:21:37.617695 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:21:37.617695 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:21:37.617695 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:21:37.617695 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:21:37.617695 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:21:37.617695 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:21:37.617695 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 21:21:37.617695 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Jul 25 21:21:37.624291 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 78/165] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Jul 25 21:21:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 372 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:21:37.625795 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072e8f05-76e6-44a8-b0d4-0c656bb8de92 None None] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:37.635011 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930ee60a-d6ab-4fb7-93df-a280b7c51114 None None] REQUEST_METHOD: `POST` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:37.635539 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930ee60a-d6ab-4fb7-93df-a280b7c51114 None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:37.635954 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930ee60a-d6ab-4fb7-93df-a280b7c51114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:37.667421 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.auth.core [None req-930ee60a-d6ab-4fb7-93df-a280b7c51114 None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:21:37.669337 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.fernet_utils [None req-930ee60a-d6ab-4fb7-93df-a280b7c51114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:21:37.690416 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c31bc9c-0930-482f-9e98-7fb33a8e5a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:37.691085 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:37.692301 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c31bc9c-0930-482f-9e98-7fb33a8e5a37 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:37.692675 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c31bc9c-0930-482f-9e98-7fb33a8e5a37 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:37.693127 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c31bc9c-0930-482f-9e98-7fb33a8e5a37 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:37.749246 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:37.786342 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 79/166] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:21:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:21:37.789097 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930ee60a-d6ab-4fb7-93df-a280b7c51114 None None] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:37.841683 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c31bc9c-0930-482f-9e98-7fb33a8e5a37 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:37.844748 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c31bc9c-0930-482f-9e98-7fb33a8e5a37 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:37.996928 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930ee60a-d6ab-4fb7-93df-a280b7c51114 None None] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:38.003520 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 88/167] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Jul 25 21:21:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 582 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 21:21:38.008918 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c31bc9c-0930-482f-9e98-7fb33a8e5a37 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:38.077615 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a9a68a-340b-410b-a2d7-5abb0b2c48c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:38.078406 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a9a68a-340b-410b-a2d7-5abb0b2c48c6 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:38.078760 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a9a68a-340b-410b-a2d7-5abb0b2c48c6 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:38.079091 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a9a68a-340b-410b-a2d7-5abb0b2c48c6 None admin] PATH_INFO: `/v3/roles` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:38.079966 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a9a68a-340b-410b-a2d7-5abb0b2c48c6 None admin] RBAC: Adding query filter params (name=member) {{(pid=87210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:21:38.080664 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:38.080948 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a9a68a-340b-410b-a2d7-5abb0b2c48c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:38.090316 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a9a68a-340b-410b-a2d7-5abb0b2c48c6 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:38.105057 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 80/168] 10.222.0.66 () {56 vars in 1101 bytes} [Mon Jul 25 21:21:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:21:38.109634 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a9a68a-340b-410b-a2d7-5abb0b2c48c6 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:38.137294 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c31bc9c-0930-482f-9e98-7fb33a8e5a37 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:38.139736 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:38.179897 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cdadff-0c5d-4798-a99b-27a06c47b153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:38.180877 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cdadff-0c5d-4798-a99b-27a06c47b153 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:38.181359 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cdadff-0c5d-4798-a99b-27a06c47b153 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:38.181835 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cdadff-0c5d-4798-a99b-27a06c47b153 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:38.194517 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cdadff-0c5d-4798-a99b-27a06c47b153 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:21:38.200982 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application [None req-76cdadff-0c5d-4798-a99b-27a06c47b153 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 21:21:38.200982 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:21:38.200982 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:21:38.200982 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:21:38.200982 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:21:38.200982 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:21:38.200982 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:21:38.200982 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:21:38.200982 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:21:38.200982 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:21:38.200982 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:21:38.200982 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:21:38.200982 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:21:38.200982 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:21:38.200982 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:21:38.200982 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:21:38.201985 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:21:38.201985 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:21:38.201985 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:21:38.201985 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:21:38.201985 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:21:38.201985 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:21:38.201985 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:21:38.201985 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:21:38.201985 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:21:38.201985 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:21:38.201985 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:21:38.201985 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application with Lock( Jul 25 21:21:38.201985 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:21:38.201985 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:21:38.201985 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:21:38.201985 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:21:38.202757 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:21:38.202757 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:21:38.202757 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:21:38.202757 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:21:38.202757 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:21:38.202757 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:21:38.202757 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:21:38.202757 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:21:38.202757 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:21:38.202757 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:21:38.202757 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 21:21:38.202757 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Jul 25 21:21:38.205302 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 89/169] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Jul 25 21:21:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:21:38.206744 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cdadff-0c5d-4798-a99b-27a06c47b153 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:38.277276 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a9a68a-340b-410b-a2d7-5abb0b2c48c6 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:38.313689 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e785ef71-3540-4fd5-8de1-3495878fb913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:38.314445 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e785ef71-3540-4fd5-8de1-3495878fb913 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:38.314780 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e785ef71-3540-4fd5-8de1-3495878fb913 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:38.315048 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e785ef71-3540-4fd5-8de1-3495878fb913 None admin] PATH_INFO: `/v3/projects/d8086440d31c4402a8800ca68927d7e1` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:38.316491 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e785ef71-3540-4fd5-8de1-3495878fb913 None admin] RBAC: Authorizing `identity:get_project(project_id=d8086440d31c4402a8800ca68927d7e1)` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:38.318009 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e785ef71-3540-4fd5-8de1-3495878fb913 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:38.319681 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 81/170] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Jul 25 21:21:38 2022] GET /identity/v3/projects/d8086440d31c4402a8800ca68927d7e1 => generated 298 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:21:38.320549 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e785ef71-3540-4fd5-8de1-3495878fb913 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:38.333913 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cdadff-0c5d-4798-a99b-27a06c47b153 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:38.349941 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:38.371952 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d86bd66-0bcb-4ef2-8f24-062e8eda918c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:38.373040 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d86bd66-0bcb-4ef2-8f24-062e8eda918c None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:38.373558 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d86bd66-0bcb-4ef2-8f24-062e8eda918c None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:38.374021 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d86bd66-0bcb-4ef2-8f24-062e8eda918c None admin] PATH_INFO: `/v3/users/598778bbdcb54a8eac7f2dcc1a1357d8` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:38.381946 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d86bd66-0bcb-4ef2-8f24-062e8eda918c None admin] RBAC: Authorizing `identity:get_user(user_id=598778bbdcb54a8eac7f2dcc1a1357d8)` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:38.383829 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d86bd66-0bcb-4ef2-8f24-062e8eda918c None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:38.385855 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 90/171] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Jul 25 21:21:38 2022] GET /identity/v3/users/598778bbdcb54a8eac7f2dcc1a1357d8 => generated 275 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:21:38.390032 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61385e5f-6c35-405c-b86f-d431a7c4ea30 None None] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:38.390762 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61385e5f-6c35-405c-b86f-d431a7c4ea30 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:38.394708 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61385e5f-6c35-405c-b86f-d431a7c4ea30 None None] PATH_INFO: `/` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:38.394708 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 91/172] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:21:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:21:38.396635 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61385e5f-6c35-405c-b86f-d431a7c4ea30 None None] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:38.488591 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:38.518034 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e785ef71-3540-4fd5-8de1-3495878fb913 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:38.524707 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61385e5f-6c35-405c-b86f-d431a7c4ea30 None None] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:38.562241 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049b3410-bd98-4907-a9ff-1808a5fe83ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:38.562870 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049b3410-bd98-4907-a9ff-1808a5fe83ee None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:38.563141 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049b3410-bd98-4907-a9ff-1808a5fe83ee None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:38.563407 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049b3410-bd98-4907-a9ff-1808a5fe83ee None admin] PATH_INFO: `/v3/roles` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:38.564121 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049b3410-bd98-4907-a9ff-1808a5fe83ee None admin] RBAC: Adding query filter params (name=member) {{(pid=87210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:21:38.564498 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049b3410-bd98-4907-a9ff-1808a5fe83ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:38.566285 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049b3410-bd98-4907-a9ff-1808a5fe83ee None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:38.583870 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 82/173] 10.222.0.66 () {56 vars in 1101 bytes} [Mon Jul 25 21:21:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:21:38.584732 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049b3410-bd98-4907-a9ff-1808a5fe83ee None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:38.590714 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79e802b-2f3c-48a6-92cd-9cd0661d235d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:38.591353 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79e802b-2f3c-48a6-92cd-9cd0661d235d None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:38.591626 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79e802b-2f3c-48a6-92cd-9cd0661d235d None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:38.591893 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79e802b-2f3c-48a6-92cd-9cd0661d235d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:38.592675 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79e802b-2f3c-48a6-92cd-9cd0661d235d None admin] RBAC: Adding query filter params (role.id=f910595b432f450eb4b382e0c99cf932, scope.project.id=d8086440d31c4402a8800ca68927d7e1, user.id=598778bbdcb54a8eac7f2dcc1a1357d8) {{(pid=87209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:21:38.592978 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79e802b-2f3c-48a6-92cd-9cd0661d235d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:38.594461 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79e802b-2f3c-48a6-92cd-9cd0661d235d None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:38.608793 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 92/174] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Jul 25 21:21:38 2022] GET /identity/v3/role_assignments?user.id=598778bbdcb54a8eac7f2dcc1a1357d8&scope.project.id=d8086440d31c4402a8800ca68927d7e1&role.id=f910595b432f450eb4b382e0c99cf932 => generated 608 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:21:38.610067 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6f6a17-d722-43e1-b9f1-cda7d663ba1f None None] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:38.610350 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6f6a17-d722-43e1-b9f1-cda7d663ba1f None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:38.610617 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6f6a17-d722-43e1-b9f1-cda7d663ba1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:38.653118 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.auth.core [None req-8c6f6a17-d722-43e1-b9f1-cda7d663ba1f None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:21:38.654335 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-8c6f6a17-d722-43e1-b9f1-cda7d663ba1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:21:38.753557 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:38.805933 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049b3410-bd98-4907-a9ff-1808a5fe83ee None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:38.807563 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 93/175] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:21:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:21:38.808426 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6f6a17-d722-43e1-b9f1-cda7d663ba1f None None] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:38.856913 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc163beb-dbe7-4c8b-bdbd-0295d1a06851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:38.857625 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc163beb-dbe7-4c8b-bdbd-0295d1a06851 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:38.857914 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc163beb-dbe7-4c8b-bdbd-0295d1a06851 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:38.858173 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc163beb-dbe7-4c8b-bdbd-0295d1a06851 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:38.901015 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:38.961329 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc163beb-dbe7-4c8b-bdbd-0295d1a06851 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:38.965120 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc163beb-dbe7-4c8b-bdbd-0295d1a06851 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:39.095945 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6f6a17-d722-43e1-b9f1-cda7d663ba1f None None] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:39.123336 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 83/176] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Jul 25 21:21:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 539 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 21:21:39.124011 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc163beb-dbe7-4c8b-bdbd-0295d1a06851 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:39.176783 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fa5160-063b-44d9-b6ec-7f1b584c3752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:39.177485 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fa5160-063b-44d9-b6ec-7f1b584c3752 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:39.177760 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fa5160-063b-44d9-b6ec-7f1b584c3752 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:39.178030 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fa5160-063b-44d9-b6ec-7f1b584c3752 None admin] PATH_INFO: `/v3/users/598778bbdcb54a8eac7f2dcc1a1357d8` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:39.179374 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fa5160-063b-44d9-b6ec-7f1b584c3752 None admin] RBAC: Authorizing `identity:get_user(user_id=598778bbdcb54a8eac7f2dcc1a1357d8)` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:39.180845 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fa5160-063b-44d9-b6ec-7f1b584c3752 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:39.182740 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 94/177] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Jul 25 21:21:38 2022] GET /identity/v3/users/598778bbdcb54a8eac7f2dcc1a1357d8 => generated 275 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:21:39.183287 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fa5160-063b-44d9-b6ec-7f1b584c3752 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:39.224168 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:39.269499 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:39.293545 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc163beb-dbe7-4c8b-bdbd-0295d1a06851 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:39.328217 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fa5160-063b-44d9-b6ec-7f1b584c3752 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:39.330160 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e0fc58-70f5-44b4-b484-75c77426bfda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:39.330885 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e0fc58-70f5-44b4-b484-75c77426bfda None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:39.331158 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e0fc58-70f5-44b4-b484-75c77426bfda None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:39.331426 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e0fc58-70f5-44b4-b484-75c77426bfda None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:39.341903 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e0fc58-70f5-44b4-b484-75c77426bfda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:21:39.347447 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application [None req-79e0fc58-70f5-44b4-b484-75c77426bfda None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 21:21:39.347447 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:21:39.347447 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:21:39.347447 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:21:39.347447 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:21:39.347447 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:21:39.347447 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:21:39.347447 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:21:39.347447 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:21:39.347447 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:21:39.347447 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:21:39.347447 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:21:39.347447 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:21:39.347447 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:21:39.347447 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:21:39.347447 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:21:39.348336 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:21:39.348336 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:21:39.348336 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:21:39.348336 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:21:39.348336 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:21:39.348336 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:21:39.348336 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:21:39.348336 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:21:39.348336 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:21:39.348336 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:21:39.348336 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:21:39.348336 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application with Lock( Jul 25 21:21:39.348336 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:21:39.348336 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:21:39.348336 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:21:39.348336 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:21:39.349518 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:21:39.349518 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:21:39.349518 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:21:39.349518 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:21:39.349518 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:21:39.349518 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:21:39.349518 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:21:39.349518 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:21:39.349518 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:21:39.349518 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:21:39.349518 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 21:21:39.349518 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Jul 25 21:21:39.349518 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 84/178] 10.222.0.66 () {56 vars in 1096 bytes} [Mon Jul 25 21:21:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:21:39.349518 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e0fc58-70f5-44b4-b484-75c77426bfda None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:39.369568 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d42463-10ad-43c4-b7ce-0b1a3152a74c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:39.370223 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d42463-10ad-43c4-b7ce-0b1a3152a74c None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:39.370494 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d42463-10ad-43c4-b7ce-0b1a3152a74c None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:39.370758 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d42463-10ad-43c4-b7ce-0b1a3152a74c None admin] PATH_INFO: `/v3/projects/6b3d6a0f3788448cbaba3c0da736a4a8` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:39.371910 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d42463-10ad-43c4-b7ce-0b1a3152a74c None admin] RBAC: Authorizing `identity:get_project(project_id=6b3d6a0f3788448cbaba3c0da736a4a8)` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:39.373392 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d42463-10ad-43c4-b7ce-0b1a3152a74c None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:39.377599 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 95/179] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Jul 25 21:21:39 2022] GET /identity/v3/projects/6b3d6a0f3788448cbaba3c0da736a4a8 => generated 312 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:21:39.377599 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b11e4d-c103-4a3b-8c2f-641908bf94a2 None None] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:39.377599 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b11e4d-c103-4a3b-8c2f-641908bf94a2 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:39.377599 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b11e4d-c103-4a3b-8c2f-641908bf94a2 None None] PATH_INFO: `/` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:39.378119 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 96/180] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:21:39 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:21:39.379132 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3378190c-47fb-47f8-8426-d46088f657ae None None] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:39.379501 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3378190c-47fb-47f8-8426-d46088f657ae None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:39.379764 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3378190c-47fb-47f8-8426-d46088f657ae None None] PATH_INFO: `/` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:39.381032 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 97/181] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:21:39 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:21:39.381750 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3378190c-47fb-47f8-8426-d46088f657ae None None] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:39.463487 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e0fc58-70f5-44b4-b484-75c77426bfda None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:39.471814 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:39.500433 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea093e05-005c-40b7-b3c3-d1c6973077cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:39.501074 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea093e05-005c-40b7-b3c3-d1c6973077cb None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:39.501449 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea093e05-005c-40b7-b3c3-d1c6973077cb None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:39.501675 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea093e05-005c-40b7-b3c3-d1c6973077cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:39.506233 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3378190c-47fb-47f8-8426-d46088f657ae None None] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:39.522711 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:39.545191 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec5efb0-0084-420f-b3ca-53fff40ba961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:39.545992 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec5efb0-0084-420f-b3ca-53fff40ba961 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:39.546117 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec5efb0-0084-420f-b3ca-53fff40ba961 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:39.546355 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec5efb0-0084-420f-b3ca-53fff40ba961 None admin] PATH_INFO: `/v3/roles` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:39.547067 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec5efb0-0084-420f-b3ca-53fff40ba961 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:21:39.547392 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec5efb0-0084-420f-b3ca-53fff40ba961 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:39.548900 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec5efb0-0084-420f-b3ca-53fff40ba961 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:39.558322 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 98/182] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Jul 25 21:21:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:21:39.563373 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec5efb0-0084-420f-b3ca-53fff40ba961 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:39.577122 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea093e05-005c-40b7-b3c3-d1c6973077cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:39.578636 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea093e05-005c-40b7-b3c3-d1c6973077cb None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:39.667049 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec5efb0-0084-420f-b3ca-53fff40ba961 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:39.678617 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 85/183] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Jul 25 21:21:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 21:21:39.681835 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8d89ed-6c62-4a9d-a5a7-c75f34be11ec None None] REQUEST_METHOD: `POST` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:39.681835 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8d89ed-6c62-4a9d-a5a7-c75f34be11ec None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:39.681835 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8d89ed-6c62-4a9d-a5a7-c75f34be11ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:39.695104 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:39.702590 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.auth.core [None req-ee8d89ed-6c62-4a9d-a5a7-c75f34be11ec None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:21:39.703992 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.fernet_utils [None req-ee8d89ed-6c62-4a9d-a5a7-c75f34be11ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:21:39.704235 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11ebf56-5f2f-43af-8f0a-03728827d02b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:39.704950 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11ebf56-5f2f-43af-8f0a-03728827d02b None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:39.705395 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11ebf56-5f2f-43af-8f0a-03728827d02b None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:39.705708 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11ebf56-5f2f-43af-8f0a-03728827d02b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:39.706623 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11ebf56-5f2f-43af-8f0a-03728827d02b None admin] RBAC: Adding query filter params (role.id=faec70ea0ba040efa587f542f054e49e, scope.project.id=6b3d6a0f3788448cbaba3c0da736a4a8, user.id=598778bbdcb54a8eac7f2dcc1a1357d8) {{(pid=87209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:21:39.706966 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11ebf56-5f2f-43af-8f0a-03728827d02b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:39.708844 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11ebf56-5f2f-43af-8f0a-03728827d02b None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:39.715820 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 99/184] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Jul 25 21:21:39 2022] GET /identity/v3/role_assignments?user.id=598778bbdcb54a8eac7f2dcc1a1357d8&scope.project.id=6b3d6a0f3788448cbaba3c0da736a4a8&role.id=faec70ea0ba040efa587f542f054e49e => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:21:39.717008 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0a9193-061c-4bd3-a594-826928922287 None None] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:39.717377 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0a9193-061c-4bd3-a594-826928922287 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:39.717643 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0a9193-061c-4bd3-a594-826928922287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:39.741658 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.auth.core [None req-0d0a9193-061c-4bd3-a594-826928922287 None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:21:39.742928 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-0d0a9193-061c-4bd3-a594-826928922287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:21:39.778900 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:39.788030 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 86/185] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:21:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:21:39.789244 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8d89ed-6c62-4a9d-a5a7-c75f34be11ec None None] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:39.831353 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 100/186] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:21:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:21:39.835575 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be59a11-d739-4df8-b646-806407b7a8ef None None] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:39.835575 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be59a11-d739-4df8-b646-806407b7a8ef None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:39.835575 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be59a11-d739-4df8-b646-806407b7a8ef None None] PATH_INFO: `/` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:39.835575 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 101/187] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:21:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:21:39.835575 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be59a11-d739-4df8-b646-806407b7a8ef None None] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:39.919155 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8d89ed-6c62-4a9d-a5a7-c75f34be11ec None None] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:39.956101 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be59a11-d739-4df8-b646-806407b7a8ef None None] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:39.961430 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c992098-a0bd-41a7-aac0-59051b511eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:39.962106 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c992098-a0bd-41a7-aac0-59051b511eb2 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:39.962382 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c992098-a0bd-41a7-aac0-59051b511eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:39.962652 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c992098-a0bd-41a7-aac0-59051b511eb2 None admin] PATH_INFO: `/v3/users/610abf22584d4ed791ca4aa98301c7fe` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:39.967984 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:39.980503 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c992098-a0bd-41a7-aac0-59051b511eb2 None admin] RBAC: Authorizing `identity:get_user(user_id=610abf22584d4ed791ca4aa98301c7fe)` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:39.982018 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c992098-a0bd-41a7-aac0-59051b511eb2 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:39.983792 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 87/188] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Jul 25 21:21:39 2022] GET /identity/v3/users/610abf22584d4ed791ca4aa98301c7fe => generated 283 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:21:39.984502 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c992098-a0bd-41a7-aac0-59051b511eb2 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:39.998708 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014b63b0-7464-449b-8a90-359152e375dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:39.999359 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014b63b0-7464-449b-8a90-359152e375dd None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:39.999634 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014b63b0-7464-449b-8a90-359152e375dd None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:39.999905 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014b63b0-7464-449b-8a90-359152e375dd None admin] PATH_INFO: `/v3/projects/d8086440d31c4402a8800ca68927d7e1` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:40.001142 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014b63b0-7464-449b-8a90-359152e375dd None admin] RBAC: Authorizing `identity:get_project(project_id=d8086440d31c4402a8800ca68927d7e1)` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:40.002841 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014b63b0-7464-449b-8a90-359152e375dd None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:40.004508 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 102/189] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Jul 25 21:21:39 2022] GET /identity/v3/projects/d8086440d31c4402a8800ca68927d7e1 => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:21:40.004508 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481f1aa5-6a69-4470-b521-02c71304251d None None] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:40.004508 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481f1aa5-6a69-4470-b521-02c71304251d None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:40.004508 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481f1aa5-6a69-4470-b521-02c71304251d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:40.024090 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.auth.core [None req-481f1aa5-6a69-4470-b521-02c71304251d None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:21:40.025321 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-481f1aa5-6a69-4470-b521-02c71304251d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:21:40.055163 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:40.094073 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c992098-a0bd-41a7-aac0-59051b511eb2 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:40.095726 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 103/190] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:21:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:21:40.101839 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481f1aa5-6a69-4470-b521-02c71304251d None None] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:40.134223 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7756e5-45cb-402a-b9be-43e2d34051d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:40.134868 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7756e5-45cb-402a-b9be-43e2d34051d0 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:40.135144 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7756e5-45cb-402a-b9be-43e2d34051d0 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:40.135414 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7756e5-45cb-402a-b9be-43e2d34051d0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:40.136546 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7756e5-45cb-402a-b9be-43e2d34051d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:40.138017 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7756e5-45cb-402a-b9be-43e2d34051d0 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:40.139612 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 88/191] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 25 21:21:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:21:40.140386 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7756e5-45cb-402a-b9be-43e2d34051d0 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:40.202681 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:40.204034 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481f1aa5-6a69-4470-b521-02c71304251d None None] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:40.240384 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae4eab6-387b-4e32-a7e0-8d92cb5215ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:40.241037 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae4eab6-387b-4e32-a7e0-8d92cb5215ad None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:40.241348 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae4eab6-387b-4e32-a7e0-8d92cb5215ad None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:40.241620 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae4eab6-387b-4e32-a7e0-8d92cb5215ad None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:40.243654 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7756e5-45cb-402a-b9be-43e2d34051d0 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:40.252117 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae4eab6-387b-4e32-a7e0-8d92cb5215ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:21:40.257106 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application [None req-bae4eab6-387b-4e32-a7e0-8d92cb5215ad None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 21:21:40.257106 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:21:40.257106 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:21:40.257106 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:21:40.257106 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:21:40.257106 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:21:40.257106 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:21:40.257106 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:21:40.257106 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:21:40.257106 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:21:40.257106 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:21:40.257106 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:21:40.257106 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:21:40.257106 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:21:40.257106 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:21:40.257106 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:21:40.258017 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:21:40.258017 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:21:40.258017 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:21:40.258017 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:21:40.258017 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:21:40.258017 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:21:40.258017 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:21:40.258017 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:21:40.258017 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:21:40.258017 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:21:40.258017 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:21:40.258017 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application with Lock( Jul 25 21:21:40.258017 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:21:40.258017 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:21:40.258017 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:21:40.258017 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:21:40.259057 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:21:40.259057 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:21:40.259057 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:21:40.259057 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:21:40.259057 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:21:40.259057 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:21:40.259057 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:21:40.259057 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:21:40.259057 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:21:40.259057 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:21:40.259057 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 21:21:40.259057 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Jul 25 21:21:40.259057 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 104/192] 10.222.0.66 () {56 vars in 1114 bytes} [Mon Jul 25 21:21:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:21:40.259057 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae4eab6-387b-4e32-a7e0-8d92cb5215ad None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:40.281772 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43acb5b1-a339-474f-abd3-0894f308c873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:40.282512 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43acb5b1-a339-474f-abd3-0894f308c873 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:40.282789 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43acb5b1-a339-474f-abd3-0894f308c873 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:40.283107 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43acb5b1-a339-474f-abd3-0894f308c873 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:40.289201 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:40.356767 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43acb5b1-a339-474f-abd3-0894f308c873 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:40.358456 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43acb5b1-a339-474f-abd3-0894f308c873 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:40.362731 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae4eab6-387b-4e32-a7e0-8d92cb5215ad None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:40.396977 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fcfb38-05de-4357-8e87-ac14f51fba45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:40.397650 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fcfb38-05de-4357-8e87-ac14f51fba45 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:40.397946 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fcfb38-05de-4357-8e87-ac14f51fba45 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:40.398209 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fcfb38-05de-4357-8e87-ac14f51fba45 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:40.399007 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fcfb38-05de-4357-8e87-ac14f51fba45 None admin] RBAC: Adding query filter params (role.id=faec70ea0ba040efa587f542f054e49e, scope.project.id=d8086440d31c4402a8800ca68927d7e1, user.id=598778bbdcb54a8eac7f2dcc1a1357d8) {{(pid=87209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:21:40.399319 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fcfb38-05de-4357-8e87-ac14f51fba45 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:40.400792 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fcfb38-05de-4357-8e87-ac14f51fba45 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:40.406836 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 105/193] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Jul 25 21:21:40 2022] GET /identity/v3/role_assignments?user.id=598778bbdcb54a8eac7f2dcc1a1357d8&scope.project.id=d8086440d31c4402a8800ca68927d7e1&role.id=faec70ea0ba040efa587f542f054e49e => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:21:40.407627 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fcfb38-05de-4357-8e87-ac14f51fba45 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:40.420782 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:40.466315 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 89/194] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Jul 25 21:21:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 21:21:40.467548 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43acb5b1-a339-474f-abd3-0894f308c873 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:40.521245 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:40.531222 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fcfb38-05de-4357-8e87-ac14f51fba45 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:40.572749 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11e8bb4-2c79-4308-b338-564d6b8f820e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:40.573505 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11e8bb4-2c79-4308-b338-564d6b8f820e None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:40.573789 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11e8bb4-2c79-4308-b338-564d6b8f820e None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:40.574061 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11e8bb4-2c79-4308-b338-564d6b8f820e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:40.586805 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11e8bb4-2c79-4308-b338-564d6b8f820e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:21:40.587964 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43acb5b1-a339-474f-abd3-0894f308c873 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:40.592308 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application [None req-b11e8bb4-2c79-4308-b338-564d6b8f820e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 21:21:40.592308 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:21:40.592308 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:21:40.592308 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:21:40.592308 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:21:40.592308 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:21:40.592308 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:21:40.592308 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:21:40.592308 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:21:40.592308 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:21:40.592308 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:21:40.592308 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:21:40.592308 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:21:40.592308 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:21:40.592308 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:21:40.592308 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:21:40.593208 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:21:40.593208 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:21:40.593208 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:21:40.593208 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:21:40.593208 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:21:40.593208 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:21:40.593208 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:21:40.593208 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:21:40.593208 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:21:40.593208 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:21:40.593208 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:21:40.593208 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application with Lock( Jul 25 21:21:40.593208 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:21:40.593208 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:21:40.593208 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:21:40.593208 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:21:40.593999 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:21:40.593999 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:21:40.593999 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:21:40.593999 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:21:40.593999 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:21:40.593999 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:21:40.593999 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:21:40.593999 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:21:40.593999 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:21:40.593999 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:21:40.593999 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 21:21:40.593999 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Jul 25 21:21:40.593999 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 106/195] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Jul 25 21:21:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:21:40.594658 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11e8bb4-2c79-4308-b338-564d6b8f820e None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:40.629767 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86ed6ac-1960-475b-b164-e965f23f1f13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:40.630402 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86ed6ac-1960-475b-b164-e965f23f1f13 None admin] REQUEST_METHOD: `POST` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:40.631482 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86ed6ac-1960-475b-b164-e965f23f1f13 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:40.631482 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86ed6ac-1960-475b-b164-e965f23f1f13 None admin] PATH_INFO: `/v3/users` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:40.631646 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86ed6ac-1960-475b-b164-e965f23f1f13 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:40.633070 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86ed6ac-1960-475b-b164-e965f23f1f13 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:40.660509 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 90/196] 10.222.0.66 () {60 vars in 1132 bytes} [Mon Jul 25 21:21:40 2022] POST /identity/v3/users => generated 297 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 21:21:40.661267 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86ed6ac-1960-475b-b164-e965f23f1f13 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:40.684070 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:40.714106 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11e8bb4-2c79-4308-b338-564d6b8f820e None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:40.752883 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991e5e4e-e782-4665-863f-0393f514669c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:40.753465 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e5e4e-e782-4665-863f-0393f514669c None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:40.753881 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e5e4e-e782-4665-863f-0393f514669c None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:40.754145 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e5e4e-e782-4665-863f-0393f514669c None admin] PATH_INFO: `/v3/roles` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:40.754747 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991e5e4e-e782-4665-863f-0393f514669c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:21:40.755055 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991e5e4e-e782-4665-863f-0393f514669c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:40.756505 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991e5e4e-e782-4665-863f-0393f514669c None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:40.766131 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 107/197] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Jul 25 21:21:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:21:40.767082 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991e5e4e-e782-4665-863f-0393f514669c None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:40.788928 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:40.796071 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86ed6ac-1960-475b-b164-e965f23f1f13 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:40.834742 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db7ad1b-78ad-49dc-9726-2fb6dc11af8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:40.835463 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db7ad1b-78ad-49dc-9726-2fb6dc11af8f None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:40.835785 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db7ad1b-78ad-49dc-9726-2fb6dc11af8f None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:40.836091 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db7ad1b-78ad-49dc-9726-2fb6dc11af8f None admin] PATH_INFO: `/v3/projects/75f1c39fe6504f958e7eea5381109120` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:40.837702 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db7ad1b-78ad-49dc-9726-2fb6dc11af8f None admin] RBAC: Authorizing `identity:get_project(project_id=75f1c39fe6504f958e7eea5381109120)` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:40.839123 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db7ad1b-78ad-49dc-9726-2fb6dc11af8f None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:40.843956 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 91/198] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Jul 25 21:21:40 2022] GET /identity/v3/projects/75f1c39fe6504f958e7eea5381109120 => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:21:40.843956 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db7ad1b-78ad-49dc-9726-2fb6dc11af8f None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:40.897728 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991e5e4e-e782-4665-863f-0393f514669c None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:40.938999 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c703d1-690a-47fa-8728-0f0b5b1edcb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:40.939931 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c703d1-690a-47fa-8728-0f0b5b1edcb6 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:40.940401 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c703d1-690a-47fa-8728-0f0b5b1edcb6 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:40.940688 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c703d1-690a-47fa-8728-0f0b5b1edcb6 None admin] PATH_INFO: `/v3/roles` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:40.941455 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c703d1-690a-47fa-8728-0f0b5b1edcb6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:21:40.941765 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c703d1-690a-47fa-8728-0f0b5b1edcb6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:40.943185 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c703d1-690a-47fa-8728-0f0b5b1edcb6 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:40.948982 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:40.952059 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 108/199] 10.222.0.66 () {56 vars in 1101 bytes} [Mon Jul 25 21:21:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:21:40.954317 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c703d1-690a-47fa-8728-0f0b5b1edcb6 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:40.965403 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db7ad1b-78ad-49dc-9726-2fb6dc11af8f None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:41.014028 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db3ce16-8897-4a6b-99d1-1701f3672d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:41.014628 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db3ce16-8897-4a6b-99d1-1701f3672d81 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:41.014914 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db3ce16-8897-4a6b-99d1-1701f3672d81 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:41.015186 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db3ce16-8897-4a6b-99d1-1701f3672d81 None admin] PATH_INFO: `/v3/users/610abf22584d4ed791ca4aa98301c7fe` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:41.016376 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db3ce16-8897-4a6b-99d1-1701f3672d81 None admin] RBAC: Authorizing `identity:get_user(user_id=610abf22584d4ed791ca4aa98301c7fe)` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:41.018829 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db3ce16-8897-4a6b-99d1-1701f3672d81 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:41.020183 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 92/200] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Jul 25 21:21:40 2022] GET /identity/v3/users/610abf22584d4ed791ca4aa98301c7fe => generated 283 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:21:41.021041 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db3ce16-8897-4a6b-99d1-1701f3672d81 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:41.056600 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:41.089567 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c703d1-690a-47fa-8728-0f0b5b1edcb6 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:41.133556 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e80886-ada7-49f1-9d02-4eb94ff12cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:41.135023 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e80886-ada7-49f1-9d02-4eb94ff12cfb None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:41.135546 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e80886-ada7-49f1-9d02-4eb94ff12cfb None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:41.135973 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e80886-ada7-49f1-9d02-4eb94ff12cfb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:41.137588 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e80886-ada7-49f1-9d02-4eb94ff12cfb None admin] RBAC: Adding query filter params (role.id=216a86497a3a4593ba08730ea8697df3, scope.project.id=75f1c39fe6504f958e7eea5381109120, user.id=610abf22584d4ed791ca4aa98301c7fe) {{(pid=87209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:21:41.138140 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e80886-ada7-49f1-9d02-4eb94ff12cfb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:41.140794 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e80886-ada7-49f1-9d02-4eb94ff12cfb None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:41.143718 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db3ce16-8897-4a6b-99d1-1701f3672d81 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:41.148676 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 109/201] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Jul 25 21:21:40 2022] GET /identity/v3/role_assignments?user.id=610abf22584d4ed791ca4aa98301c7fe&scope.project.id=75f1c39fe6504f958e7eea5381109120&role.id=216a86497a3a4593ba08730ea8697df3 => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:21:41.149734 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e80886-ada7-49f1-9d02-4eb94ff12cfb None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:41.212521 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e79c978-6f39-4aea-a5f4-22d5c0d88bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:41.213230 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e79c978-6f39-4aea-a5f4-22d5c0d88bec None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:41.213515 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e79c978-6f39-4aea-a5f4-22d5c0d88bec None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:41.213804 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e79c978-6f39-4aea-a5f4-22d5c0d88bec None admin] PATH_INFO: `/v3/users/ddde747b461549108051f8e0a81f50fd` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:41.215103 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e79c978-6f39-4aea-a5f4-22d5c0d88bec None admin] RBAC: Authorizing `identity:get_user(user_id=ddde747b461549108051f8e0a81f50fd)` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:41.216591 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e79c978-6f39-4aea-a5f4-22d5c0d88bec None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:41.218306 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 93/202] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Jul 25 21:21:41 2022] GET /identity/v3/users/ddde747b461549108051f8e0a81f50fd => generated 289 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:21:41.224636 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e79c978-6f39-4aea-a5f4-22d5c0d88bec None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:41.257858 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:41.379583 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e80886-ada7-49f1-9d02-4eb94ff12cfb None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:41.400950 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e79c978-6f39-4aea-a5f4-22d5c0d88bec None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:41.425983 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c751a8-902b-4f55-9fd1-7c102e5b3ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:41.426642 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c751a8-902b-4f55-9fd1-7c102e5b3ea7 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:41.426923 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c751a8-902b-4f55-9fd1-7c102e5b3ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:41.427198 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c751a8-902b-4f55-9fd1-7c102e5b3ea7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:41.439469 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:41.447895 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a30c2d-9f46-4c9d-958a-e5b89c14d5e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:41.448533 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a30c2d-9f46-4c9d-958a-e5b89c14d5e2 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:41.448809 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a30c2d-9f46-4c9d-958a-e5b89c14d5e2 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:41.449365 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a30c2d-9f46-4c9d-958a-e5b89c14d5e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:41.529528 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c751a8-902b-4f55-9fd1-7c102e5b3ea7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:41.531293 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c751a8-902b-4f55-9fd1-7c102e5b3ea7 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:41.601853 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a30c2d-9f46-4c9d-958a-e5b89c14d5e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:41.603530 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a30c2d-9f46-4c9d-958a-e5b89c14d5e2 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:41.630285 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:41.705010 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 110/203] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Jul 25 21:21:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 556 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 21:21:41.711836 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c751a8-902b-4f55-9fd1-7c102e5b3ea7 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:41.715090 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 94/204] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Jul 25 21:21:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 21:21:41.726325 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a30c2d-9f46-4c9d-958a-e5b89c14d5e2 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:41.756293 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:41.818155 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c751a8-902b-4f55-9fd1-7c102e5b3ea7 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:41.855049 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e9871f-4270-47e4-aa27-ccbed0307401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:41.855719 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e9871f-4270-47e4-aa27-ccbed0307401 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:41.855993 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e9871f-4270-47e4-aa27-ccbed0307401 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:41.856261 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e9871f-4270-47e4-aa27-ccbed0307401 None admin] PATH_INFO: `/v3/projects/75f1c39fe6504f958e7eea5381109120` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:41.857482 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e9871f-4270-47e4-aa27-ccbed0307401 None admin] RBAC: Authorizing `identity:get_project(project_id=75f1c39fe6504f958e7eea5381109120)` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:41.863040 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e9871f-4270-47e4-aa27-ccbed0307401 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:41.863040 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 111/205] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Jul 25 21:21:41 2022] GET /identity/v3/projects/75f1c39fe6504f958e7eea5381109120 => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:21:41.868406 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e9871f-4270-47e4-aa27-ccbed0307401 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:41.944405 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a30c2d-9f46-4c9d-958a-e5b89c14d5e2 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:41.990701 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:42.015146 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97187989-a7bb-4ed4-93eb-efae2fd36918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:42.015809 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97187989-a7bb-4ed4-93eb-efae2fd36918 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:42.016081 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97187989-a7bb-4ed4-93eb-efae2fd36918 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:42.016344 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97187989-a7bb-4ed4-93eb-efae2fd36918 None admin] PATH_INFO: `/v3/projects/d8086440d31c4402a8800ca68927d7e1` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:42.019090 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e9871f-4270-47e4-aa27-ccbed0307401 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:42.019931 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97187989-a7bb-4ed4-93eb-efae2fd36918 None admin] RBAC: Authorizing `identity:get_project(project_id=d8086440d31c4402a8800ca68927d7e1)` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:42.021435 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97187989-a7bb-4ed4-93eb-efae2fd36918 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:42.023444 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 95/206] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Jul 25 21:21:41 2022] GET /identity/v3/projects/d8086440d31c4402a8800ca68927d7e1 => generated 298 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:21:42.031394 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:42.039815 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97187989-a7bb-4ed4-93eb-efae2fd36918 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:42.107956 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef604bf-4fa5-441b-8e21-a1aab5258268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:42.108569 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef604bf-4fa5-441b-8e21-a1aab5258268 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:42.108943 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef604bf-4fa5-441b-8e21-a1aab5258268 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:42.109352 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef604bf-4fa5-441b-8e21-a1aab5258268 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:42.113103 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef604bf-4fa5-441b-8e21-a1aab5258268 None admin] RBAC: Adding query filter params (role.id=f910595b432f450eb4b382e0c99cf932, scope.project.id=75f1c39fe6504f958e7eea5381109120, user.id=610abf22584d4ed791ca4aa98301c7fe) {{(pid=87209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:21:42.113103 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef604bf-4fa5-441b-8e21-a1aab5258268 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:42.113103 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef604bf-4fa5-441b-8e21-a1aab5258268 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:42.135273 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 112/207] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Jul 25 21:21:41 2022] GET /identity/v3/role_assignments?user.id=610abf22584d4ed791ca4aa98301c7fe&scope.project.id=75f1c39fe6504f958e7eea5381109120&role.id=f910595b432f450eb4b382e0c99cf932 => generated 259 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:21:42.320123 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97187989-a7bb-4ed4-93eb-efae2fd36918 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:42.356391 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292f045a-8a36-4fe3-95ba-c4e86da361b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:42.357014 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292f045a-8a36-4fe3-95ba-c4e86da361b1 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:42.357337 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292f045a-8a36-4fe3-95ba-c4e86da361b1 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:42.357590 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292f045a-8a36-4fe3-95ba-c4e86da361b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:42.358396 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292f045a-8a36-4fe3-95ba-c4e86da361b1 None admin] RBAC: Adding query filter params (role.id=ca991b54c98340d797cf644d4217dca9, scope.project.id=d8086440d31c4402a8800ca68927d7e1, user.id=ddde747b461549108051f8e0a81f50fd) {{(pid=87210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:21:42.358698 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292f045a-8a36-4fe3-95ba-c4e86da361b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:42.360273 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292f045a-8a36-4fe3-95ba-c4e86da361b1 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:42.366633 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 96/208] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Jul 25 21:21:42 2022] GET /identity/v3/role_assignments?user.id=ddde747b461549108051f8e0a81f50fd&scope.project.id=d8086440d31c4402a8800ca68927d7e1&role.id=ca991b54c98340d797cf644d4217dca9 => generated 608 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:21:43.297239 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853f5f85-d4a3-4b7c-aab6-d5b377b46460 None None] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:43.297770 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853f5f85-d4a3-4b7c-aab6-d5b377b46460 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:43.298157 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853f5f85-d4a3-4b7c-aab6-d5b377b46460 None None] PATH_INFO: `/` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:43.300079 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 113/209] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:21:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:21:43.305570 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e55c0c-6d85-4244-b14b-cfd212e32033 None None] REQUEST_METHOD: `POST` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:43.305989 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e55c0c-6d85-4244-b14b-cfd212e32033 None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:43.306452 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e55c0c-6d85-4244-b14b-cfd212e32033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:43.325623 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.auth.core [None req-d8e55c0c-6d85-4244-b14b-cfd212e32033 None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:21:43.326990 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.fernet_utils [None req-d8e55c0c-6d85-4244-b14b-cfd212e32033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:21:43.334403 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f77c56-1b4f-4a98-b8a5-ba34bc384445 None None] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:43.334975 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f77c56-1b4f-4a98-b8a5-ba34bc384445 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:43.335464 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f77c56-1b4f-4a98-b8a5-ba34bc384445 None None] PATH_INFO: `/` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:43.337186 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 114/210] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:21:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 21:21:43.342054 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd338f28-7327-46cd-a77f-282da89450c3 None None] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:43.342407 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd338f28-7327-46cd-a77f-282da89450c3 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:43.342762 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd338f28-7327-46cd-a77f-282da89450c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:43.360867 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.auth.core [None req-cd338f28-7327-46cd-a77f-282da89450c3 None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:21:43.362879 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-cd338f28-7327-46cd-a77f-282da89450c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:21:43.381548 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:43.409282 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 97/211] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:21:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:21:43.433850 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e55c0c-6d85-4244-b14b-cfd212e32033 None None] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:43.465104 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 115/212] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:21:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:21:43.484664 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd338f28-7327-46cd-a77f-282da89450c3 None None] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:43.556884 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e55c0c-6d85-4244-b14b-cfd212e32033 None None] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:43.595298 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5981350a-a9b6-4ddc-92cf-0fa953bd1bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:43.596461 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5981350a-a9b6-4ddc-92cf-0fa953bd1bd0 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:43.596937 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5981350a-a9b6-4ddc-92cf-0fa953bd1bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:43.597434 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5981350a-a9b6-4ddc-92cf-0fa953bd1bd0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:43.608141 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:43.612972 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd338f28-7327-46cd-a77f-282da89450c3 None None] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:43.616239 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5981350a-a9b6-4ddc-92cf-0fa953bd1bd0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:21:43.622587 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application [None req-5981350a-a9b6-4ddc-92cf-0fa953bd1bd0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 21:21:43.622587 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:21:43.622587 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:21:43.622587 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:21:43.622587 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:21:43.622587 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:21:43.622587 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:21:43.622587 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:21:43.622587 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:21:43.622587 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:21:43.622587 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:21:43.622587 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:21:43.622587 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:21:43.622587 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:21:43.622587 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:21:43.622587 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:21:43.623508 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:21:43.623508 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:21:43.623508 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:21:43.623508 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:21:43.623508 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:21:43.623508 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:21:43.623508 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:21:43.623508 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:21:43.623508 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:21:43.623508 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:21:43.623508 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:21:43.623508 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application with Lock( Jul 25 21:21:43.623508 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:21:43.623508 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:21:43.623508 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:21:43.623508 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:21:43.624291 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:21:43.624291 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:21:43.624291 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:21:43.624291 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:21:43.624291 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:21:43.624291 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:21:43.624291 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:21:43.624291 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:21:43.624291 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:21:43.624291 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:21:43.624291 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 21:21:43.624291 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Jul 25 21:21:43.632069 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 98/213] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Jul 25 21:21:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 21:21:43.633470 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5981350a-a9b6-4ddc-92cf-0fa953bd1bd0 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:43.688044 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:43.750140 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5981350a-a9b6-4ddc-92cf-0fa953bd1bd0 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:43.772937 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9245b970-2279-49ca-b14a-2526368889b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:43.773768 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9245b970-2279-49ca-b14a-2526368889b0 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:43.774108 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9245b970-2279-49ca-b14a-2526368889b0 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:43.774470 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9245b970-2279-49ca-b14a-2526368889b0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:43.775709 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9245b970-2279-49ca-b14a-2526368889b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:43.777277 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9245b970-2279-49ca-b14a-2526368889b0 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:43.778980 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 116/214] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 25 21:21:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:21:43.784454 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9245b970-2279-49ca-b14a-2526368889b0 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:43.787837 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc7eff2-dd62-40b4-9ca2-4834d66112b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:43.788645 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc7eff2-dd62-40b4-9ca2-4834d66112b2 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:43.789051 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc7eff2-dd62-40b4-9ca2-4834d66112b2 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:43.789498 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc7eff2-dd62-40b4-9ca2-4834d66112b2 None admin] PATH_INFO: `/v3/roles` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:43.790691 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc7eff2-dd62-40b4-9ca2-4834d66112b2 None admin] RBAC: Adding query filter params (name=member) {{(pid=87210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:21:43.791128 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc7eff2-dd62-40b4-9ca2-4834d66112b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:43.792651 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc7eff2-dd62-40b4-9ca2-4834d66112b2 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:43.801906 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 99/215] 10.222.0.66 () {56 vars in 1101 bytes} [Mon Jul 25 21:21:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:21:43.807751 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc7eff2-dd62-40b4-9ca2-4834d66112b2 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:43.894669 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9245b970-2279-49ca-b14a-2526368889b0 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:43.923484 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc7eff2-dd62-40b4-9ca2-4834d66112b2 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:43.930895 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0102340f-c359-4cb9-b7d8-9d1e8c466376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:43.931643 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:43.931759 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0102340f-c359-4cb9-b7d8-9d1e8c466376 None admin] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:43.932101 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0102340f-c359-4cb9-b7d8-9d1e8c466376 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:43.932612 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0102340f-c359-4cb9-b7d8-9d1e8c466376 None admin] PATH_INFO: `/v3/users` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:43.933285 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0102340f-c359-4cb9-b7d8-9d1e8c466376 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:43.934844 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0102340f-c359-4cb9-b7d8-9d1e8c466376 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:43.968308 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287ef57f-0d52-4b21-bfa6-65d2f960fa32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:43.969439 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287ef57f-0d52-4b21-bfa6-65d2f960fa32 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:43.970038 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287ef57f-0d52-4b21-bfa6-65d2f960fa32 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:43.970565 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287ef57f-0d52-4b21-bfa6-65d2f960fa32 None admin] PATH_INFO: `/v3/users/97d9cdca60ea4461a6a2e844e4807837` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:43.973275 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 117/216] 10.222.0.66 () {60 vars in 1132 bytes} [Mon Jul 25 21:21:43 2022] POST /identity/v3/users => generated 297 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 21:21:43.978695 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b274aa8d-7c5d-48fc-98b5-058a481a0645 None None] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:43.979024 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b274aa8d-7c5d-48fc-98b5-058a481a0645 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:43.979256 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b274aa8d-7c5d-48fc-98b5-058a481a0645 None None] PATH_INFO: `/` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:43.980678 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 118/217] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:21:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:21:43.987002 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac50cfe5-1f7f-4b16-b72c-61db3da0c619 None None] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:43.987361 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac50cfe5-1f7f-4b16-b72c-61db3da0c619 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:43.987649 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac50cfe5-1f7f-4b16-b72c-61db3da0c619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:43.988913 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287ef57f-0d52-4b21-bfa6-65d2f960fa32 None admin] RBAC: Authorizing `identity:get_user(user_id=97d9cdca60ea4461a6a2e844e4807837)` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:43.990668 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287ef57f-0d52-4b21-bfa6-65d2f960fa32 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:43.992713 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 100/218] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Jul 25 21:21:43 2022] GET /identity/v3/users/97d9cdca60ea4461a6a2e844e4807837 => generated 297 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:21:43.998721 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287ef57f-0d52-4b21-bfa6-65d2f960fa32 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:44.008267 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.auth.core [None req-ac50cfe5-1f7f-4b16-b72c-61db3da0c619 None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:21:44.009552 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-ac50cfe5-1f7f-4b16-b72c-61db3da0c619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:21:44.033220 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:44.107233 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 119/219] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:21:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 21:21:44.132055 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac50cfe5-1f7f-4b16-b72c-61db3da0c619 None None] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:44.139962 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287ef57f-0d52-4b21-bfa6-65d2f960fa32 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:44.186490 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac6989d-00a3-4390-8aca-e2982f285842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:44.187123 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac6989d-00a3-4390-8aca-e2982f285842 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:44.187397 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac6989d-00a3-4390-8aca-e2982f285842 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:44.187665 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac6989d-00a3-4390-8aca-e2982f285842 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:44.226232 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:44.264587 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac50cfe5-1f7f-4b16-b72c-61db3da0c619 None None] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:44.268675 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac6989d-00a3-4390-8aca-e2982f285842 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:44.270231 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac6989d-00a3-4390-8aca-e2982f285842 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:44.316817 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891b6f02-466c-47e0-b6e4-9eefb5f3a8fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:44.316817 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891b6f02-466c-47e0-b6e4-9eefb5f3a8fd None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:44.316817 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891b6f02-466c-47e0-b6e4-9eefb5f3a8fd None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:44.317527 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891b6f02-466c-47e0-b6e4-9eefb5f3a8fd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:44.332524 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891b6f02-466c-47e0-b6e4-9eefb5f3a8fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:21:44.338525 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application [None req-891b6f02-466c-47e0-b6e4-9eefb5f3a8fd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 21:21:44.338525 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:21:44.338525 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:21:44.338525 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:21:44.338525 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:21:44.338525 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:21:44.338525 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:21:44.338525 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:21:44.338525 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:21:44.338525 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:21:44.338525 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:21:44.338525 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:21:44.338525 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:21:44.338525 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:21:44.338525 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:21:44.338525 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:21:44.339398 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:21:44.339398 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:21:44.339398 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:21:44.339398 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:21:44.339398 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:21:44.339398 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:21:44.339398 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:21:44.339398 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:21:44.339398 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:21:44.339398 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:21:44.339398 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:21:44.339398 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application with Lock( Jul 25 21:21:44.339398 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:21:44.339398 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:21:44.339398 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:21:44.339398 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:21:44.340188 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:21:44.340188 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:21:44.340188 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:21:44.340188 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:21:44.340188 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:21:44.340188 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:21:44.340188 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:21:44.340188 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:21:44.340188 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:21:44.340188 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:21:44.340188 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 21:21:44.340188 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Jul 25 21:21:44.340188 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 120/220] 10.222.0.66 () {56 vars in 1096 bytes} [Mon Jul 25 21:21:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:21:44.346009 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891b6f02-466c-47e0-b6e4-9eefb5f3a8fd None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:44.367476 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:44.410630 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 101/221] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Jul 25 21:21:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 25 21:21:44.416864 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac6989d-00a3-4390-8aca-e2982f285842 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:44.484402 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891b6f02-466c-47e0-b6e4-9eefb5f3a8fd None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:44.504274 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:44.536474 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc246a2e-cca9-47b4-9883-1f4cb367dced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:44.537138 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc246a2e-cca9-47b4-9883-1f4cb367dced None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:44.537425 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc246a2e-cca9-47b4-9883-1f4cb367dced None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:44.537694 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc246a2e-cca9-47b4-9883-1f4cb367dced None admin] PATH_INFO: `/v3/roles` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:44.539057 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc246a2e-cca9-47b4-9883-1f4cb367dced None admin] RBAC: Adding query filter params (name=admin) {{(pid=87209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:21:44.539366 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc246a2e-cca9-47b4-9883-1f4cb367dced None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:44.541883 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc246a2e-cca9-47b4-9883-1f4cb367dced None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:44.553955 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac6989d-00a3-4390-8aca-e2982f285842 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:44.554922 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 121/222] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Jul 25 21:21:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:21:44.560526 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc246a2e-cca9-47b4-9883-1f4cb367dced None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:44.629496 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f445f063-5699-4c2a-99da-1dddb3a27b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:44.630076 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f445f063-5699-4c2a-99da-1dddb3a27b78 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:44.630389 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f445f063-5699-4c2a-99da-1dddb3a27b78 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:44.630659 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f445f063-5699-4c2a-99da-1dddb3a27b78 None admin] PATH_INFO: `/v3/projects/75f1c39fe6504f958e7eea5381109120` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:44.634791 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f445f063-5699-4c2a-99da-1dddb3a27b78 None admin] RBAC: Authorizing `identity:get_project(project_id=75f1c39fe6504f958e7eea5381109120)` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:44.636275 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f445f063-5699-4c2a-99da-1dddb3a27b78 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:44.639654 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 102/223] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Jul 25 21:21:44 2022] GET /identity/v3/projects/75f1c39fe6504f958e7eea5381109120 => generated 302 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:21:44.647145 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f445f063-5699-4c2a-99da-1dddb3a27b78 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:44.696193 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:44.723339 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc246a2e-cca9-47b4-9883-1f4cb367dced None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:44.770250 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6d3c42-474a-4fb7-827a-44dd2e57123a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:44.771167 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6d3c42-474a-4fb7-827a-44dd2e57123a None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:44.771447 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6d3c42-474a-4fb7-827a-44dd2e57123a None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:44.771744 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6d3c42-474a-4fb7-827a-44dd2e57123a None admin] PATH_INFO: `/v3/users/610abf22584d4ed791ca4aa98301c7fe` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:44.772970 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6d3c42-474a-4fb7-827a-44dd2e57123a None admin] RBAC: Authorizing `identity:get_user(user_id=610abf22584d4ed791ca4aa98301c7fe)` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:44.774580 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6d3c42-474a-4fb7-827a-44dd2e57123a None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:44.776213 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 122/224] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Jul 25 21:21:44 2022] GET /identity/v3/users/610abf22584d4ed791ca4aa98301c7fe => generated 283 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:21:44.780548 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae74896-2d45-4a49-871b-0fda22d86682 None None] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:44.780548 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae74896-2d45-4a49-871b-0fda22d86682 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:44.780548 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae74896-2d45-4a49-871b-0fda22d86682 None None] PATH_INFO: `/` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:44.780548 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 123/225] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:21:44 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:21:44.783832 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae74896-2d45-4a49-871b-0fda22d86682 None None] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:44.791138 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f445f063-5699-4c2a-99da-1dddb3a27b78 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:44.831427 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:44.837299 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf13c980-10e9-416d-b957-2e8ee5df6112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:44.838523 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf13c980-10e9-416d-b957-2e8ee5df6112 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:44.838995 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf13c980-10e9-416d-b957-2e8ee5df6112 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:44.839485 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf13c980-10e9-416d-b957-2e8ee5df6112 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:44.840501 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf13c980-10e9-416d-b957-2e8ee5df6112 None admin] RBAC: Adding query filter params (role.id=faec70ea0ba040efa587f542f054e49e, scope.project.id=75f1c39fe6504f958e7eea5381109120, user.id=97d9cdca60ea4461a6a2e844e4807837) {{(pid=87210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:21:44.841010 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf13c980-10e9-416d-b957-2e8ee5df6112 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:44.844326 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf13c980-10e9-416d-b957-2e8ee5df6112 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:44.851246 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 103/226] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Jul 25 21:21:44 2022] GET /identity/v3/role_assignments?user.id=97d9cdca60ea4461a6a2e844e4807837&scope.project.id=75f1c39fe6504f958e7eea5381109120&role.id=faec70ea0ba040efa587f542f054e49e => generated 259 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:21:44.852834 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5be83c4-b9c0-42b9-a621-8472d27da47e None None] REQUEST_METHOD: `POST` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:44.853352 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5be83c4-b9c0-42b9-a621-8472d27da47e None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:44.853834 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5be83c4-b9c0-42b9-a621-8472d27da47e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:44.874048 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.auth.core [None req-a5be83c4-b9c0-42b9-a621-8472d27da47e None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:21:44.875677 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.fernet_utils [None req-a5be83c4-b9c0-42b9-a621-8472d27da47e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:21:44.943890 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae74896-2d45-4a49-871b-0fda22d86682 None None] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:44.993619 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 104/227] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:21:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:21:45.015867 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5be83c4-b9c0-42b9-a621-8472d27da47e None None] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:45.017629 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ed8f7c-355e-4de1-a6bd-f4a19f8d5e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:45.018590 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ed8f7c-355e-4de1-a6bd-f4a19f8d5e34 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:45.018859 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ed8f7c-355e-4de1-a6bd-f4a19f8d5e34 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:45.020041 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ed8f7c-355e-4de1-a6bd-f4a19f8d5e34 None admin] PATH_INFO: `/v3/projects/75f1c39fe6504f958e7eea5381109120` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:45.026116 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ed8f7c-355e-4de1-a6bd-f4a19f8d5e34 None admin] RBAC: Authorizing `identity:get_project(project_id=75f1c39fe6504f958e7eea5381109120)` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:45.027640 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ed8f7c-355e-4de1-a6bd-f4a19f8d5e34 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:45.033927 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 124/228] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Jul 25 21:21:44 2022] GET /identity/v3/projects/75f1c39fe6504f958e7eea5381109120 => generated 302 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:21:45.045035 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ed8f7c-355e-4de1-a6bd-f4a19f8d5e34 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:45.072900 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:45.134454 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5be83c4-b9c0-42b9-a621-8472d27da47e None None] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:45.162071 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:45.172595 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2422ea-947c-45de-a259-1f6a8f2fcdf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:45.173285 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2422ea-947c-45de-a259-1f6a8f2fcdf9 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:45.173630 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2422ea-947c-45de-a259-1f6a8f2fcdf9 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:45.173933 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2422ea-947c-45de-a259-1f6a8f2fcdf9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:45.190571 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2422ea-947c-45de-a259-1f6a8f2fcdf9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:21:45.195735 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application [None req-ae2422ea-947c-45de-a259-1f6a8f2fcdf9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 21:21:45.195735 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:21:45.195735 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:21:45.195735 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:21:45.195735 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:21:45.195735 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:21:45.195735 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:21:45.195735 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:21:45.195735 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:21:45.195735 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:21:45.195735 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:21:45.195735 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:21:45.195735 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:21:45.195735 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:21:45.195735 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:21:45.195735 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:21:45.196618 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:21:45.196618 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:21:45.196618 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:21:45.196618 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:21:45.196618 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:21:45.196618 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:21:45.196618 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:21:45.196618 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:21:45.196618 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:21:45.196618 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:21:45.196618 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:21:45.196618 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application with Lock( Jul 25 21:21:45.196618 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:21:45.196618 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:21:45.196618 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:21:45.196618 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:21:45.197467 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:21:45.197467 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:21:45.197467 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:21:45.197467 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:21:45.197467 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:21:45.197467 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:21:45.197467 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:21:45.197467 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:21:45.197467 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:21:45.197467 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:21:45.197467 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 21:21:45.197467 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Jul 25 21:21:45.197467 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 105/229] 10.222.0.66 () {56 vars in 1114 bytes} [Mon Jul 25 21:21:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 21:21:45.204178 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2422ea-947c-45de-a259-1f6a8f2fcdf9 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:45.249069 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ed8f7c-355e-4de1-a6bd-f4a19f8d5e34 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:45.319235 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659d500b-0d6f-401b-bdd0-ea37e2b1714d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:45.320690 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659d500b-0d6f-401b-bdd0-ea37e2b1714d None admin] REQUEST_METHOD: `PUT` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:45.321364 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659d500b-0d6f-401b-bdd0-ea37e2b1714d None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:45.322530 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659d500b-0d6f-401b-bdd0-ea37e2b1714d None admin] PATH_INFO: `/v3/projects/75f1c39fe6504f958e7eea5381109120/users/610abf22584d4ed791ca4aa98301c7fe/roles/216a86497a3a4593ba08730ea8697df3` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:45.326097 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659d500b-0d6f-401b-bdd0-ea37e2b1714d None admin] RBAC: Authorizing `identity:create_grant(project_id=75f1c39fe6504f958e7eea5381109120, user_id=610abf22584d4ed791ca4aa98301c7fe, role_id=216a86497a3a4593ba08730ea8697df3)` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:45.328530 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659d500b-0d6f-401b-bdd0-ea37e2b1714d None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:45.339099 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2422ea-947c-45de-a259-1f6a8f2fcdf9 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:45.361328 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 125/230] 10.222.0.66 () {58 vars in 1439 bytes} [Mon Jul 25 21:21:45 2022] PUT /identity/v3/projects/75f1c39fe6504f958e7eea5381109120/users/610abf22584d4ed791ca4aa98301c7fe/roles/216a86497a3a4593ba08730ea8697df3 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 21:21:45.395001 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996e90ef-b972-4c05-905b-ea2469297f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:45.395634 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996e90ef-b972-4c05-905b-ea2469297f8b None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:45.395911 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996e90ef-b972-4c05-905b-ea2469297f8b None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:45.396182 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996e90ef-b972-4c05-905b-ea2469297f8b None admin] PATH_INFO: `/v3/roles` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:45.396900 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996e90ef-b972-4c05-905b-ea2469297f8b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:21:45.397225 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996e90ef-b972-4c05-905b-ea2469297f8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:45.398683 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996e90ef-b972-4c05-905b-ea2469297f8b None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:45.412211 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 106/231] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Jul 25 21:21:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:21:45.413514 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659d500b-0d6f-401b-bdd0-ea37e2b1714d None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:45.514359 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:45.557573 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659d500b-0d6f-401b-bdd0-ea37e2b1714d None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:45.609448 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821bb23f-ee0f-4f87-be69-1358bb20f659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:45.610114 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821bb23f-ee0f-4f87-be69-1358bb20f659 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:45.610393 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821bb23f-ee0f-4f87-be69-1358bb20f659 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:45.610668 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821bb23f-ee0f-4f87-be69-1358bb20f659 None admin] PATH_INFO: `/v3/users/610abf22584d4ed791ca4aa98301c7fe` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:45.613961 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821bb23f-ee0f-4f87-be69-1358bb20f659 None admin] RBAC: Authorizing `identity:get_user(user_id=610abf22584d4ed791ca4aa98301c7fe)` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:45.615478 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821bb23f-ee0f-4f87-be69-1358bb20f659 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:45.617228 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 126/232] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Jul 25 21:21:45 2022] GET /identity/v3/users/610abf22584d4ed791ca4aa98301c7fe => generated 283 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:21:45.624660 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996e90ef-b972-4c05-905b-ea2469297f8b None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:45.683949 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:45.744729 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996e90ef-b972-4c05-905b-ea2469297f8b None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:45.782480 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed970836-8c24-491c-813d-013890e3975f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:45.783562 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed970836-8c24-491c-813d-013890e3975f None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:45.783989 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed970836-8c24-491c-813d-013890e3975f None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:45.784399 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed970836-8c24-491c-813d-013890e3975f None admin] PATH_INFO: `/v3/projects/75f1c39fe6504f958e7eea5381109120` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:45.789926 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed970836-8c24-491c-813d-013890e3975f None admin] RBAC: Authorizing `identity:get_project(project_id=75f1c39fe6504f958e7eea5381109120)` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:45.791976 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed970836-8c24-491c-813d-013890e3975f None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:45.794037 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 107/233] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Jul 25 21:21:45 2022] GET /identity/v3/projects/75f1c39fe6504f958e7eea5381109120 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:21:45.800387 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821bb23f-ee0f-4f87-be69-1358bb20f659 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:45.954307 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821bb23f-ee0f-4f87-be69-1358bb20f659 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:45.992877 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884c1aed-0bc3-455a-b2bc-30d51d3c0fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:45.993848 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884c1aed-0bc3-455a-b2bc-30d51d3c0fbd None admin] REQUEST_METHOD: `PUT` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:45.994274 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884c1aed-0bc3-455a-b2bc-30d51d3c0fbd None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:45.994694 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884c1aed-0bc3-455a-b2bc-30d51d3c0fbd None admin] PATH_INFO: `/v3/projects/75f1c39fe6504f958e7eea5381109120/users/610abf22584d4ed791ca4aa98301c7fe/roles/f910595b432f450eb4b382e0c99cf932` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:45.997199 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884c1aed-0bc3-455a-b2bc-30d51d3c0fbd None admin] RBAC: Authorizing `identity:create_grant(project_id=75f1c39fe6504f958e7eea5381109120, user_id=610abf22584d4ed791ca4aa98301c7fe, role_id=f910595b432f450eb4b382e0c99cf932)` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:45.998907 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884c1aed-0bc3-455a-b2bc-30d51d3c0fbd None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:46.013121 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:46.018095 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 127/234] 10.222.0.66 () {58 vars in 1439 bytes} [Mon Jul 25 21:21:45 2022] PUT /identity/v3/projects/75f1c39fe6504f958e7eea5381109120/users/610abf22584d4ed791ca4aa98301c7fe/roles/f910595b432f450eb4b382e0c99cf932 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 21:21:46.912031 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669c0622-ecf6-4de9-b23d-fdc9a3e89357 None None] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:46.912566 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669c0622-ecf6-4de9-b23d-fdc9a3e89357 None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:46.912791 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669c0622-ecf6-4de9-b23d-fdc9a3e89357 None None] PATH_INFO: `/` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:46.914676 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 108/235] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:21:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:21:46.921097 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe917966-0e33-4d03-be0e-6fd4052b84c1 None None] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:46.921938 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe917966-0e33-4d03-be0e-6fd4052b84c1 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:46.922422 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe917966-0e33-4d03-be0e-6fd4052b84c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:46.945830 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.auth.core [None req-fe917966-0e33-4d03-be0e-6fd4052b84c1 None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:21:46.947873 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-fe917966-0e33-4d03-be0e-6fd4052b84c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:21:47.037272 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f5abd2-7e54-4546-8a98-bb79e43618d5 None None] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:47.037591 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f5abd2-7e54-4546-8a98-bb79e43618d5 None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:47.037834 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f5abd2-7e54-4546-8a98-bb79e43618d5 None None] PATH_INFO: `/` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:47.039199 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 109/236] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:21:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 21:21:47.042117 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 128/237] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:21:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 21:21:47.046666 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3237dc-de78-48f2-9c65-f6610c05d6ef None None] REQUEST_METHOD: `POST` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:47.046949 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3237dc-de78-48f2-9c65-f6610c05d6ef None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:47.047225 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3237dc-de78-48f2-9c65-f6610c05d6ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:47.073621 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.auth.core [None req-0b3237dc-de78-48f2-9c65-f6610c05d6ef None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:21:47.075164 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.fernet_utils [None req-0b3237dc-de78-48f2-9c65-f6610c05d6ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:21:47.078439 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe917966-0e33-4d03-be0e-6fd4052b84c1 None None] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:47.165486 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 110/238] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:21:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:21:47.205730 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3237dc-de78-48f2-9c65-f6610c05d6ef None None] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:47.221105 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe917966-0e33-4d03-be0e-6fd4052b84c1 None None] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:47.249443 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:47.256666 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e631287-9f2f-4a84-b068-a1799cdf70d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:47.258249 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e631287-9f2f-4a84-b068-a1799cdf70d1 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:47.258533 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e631287-9f2f-4a84-b068-a1799cdf70d1 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:47.258809 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e631287-9f2f-4a84-b068-a1799cdf70d1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:47.261316 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e631287-9f2f-4a84-b068-a1799cdf70d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:47.262791 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e631287-9f2f-4a84-b068-a1799cdf70d1 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:47.264421 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 129/239] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 25 21:21:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:21:47.270453 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e631287-9f2f-4a84-b068-a1799cdf70d1 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:47.296024 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:47.410977 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3237dc-de78-48f2-9c65-f6610c05d6ef None None] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:47.424397 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e631287-9f2f-4a84-b068-a1799cdf70d1 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:47.470233 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed6d9ca-10c2-468c-b94f-a8d1809496f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:47.470968 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed6d9ca-10c2-468c-b94f-a8d1809496f0 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:47.471243 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed6d9ca-10c2-468c-b94f-a8d1809496f0 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:47.471508 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed6d9ca-10c2-468c-b94f-a8d1809496f0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:47.483230 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce17beb-f0b1-40a9-85ae-eb78a6daad11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:47.483862 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce17beb-f0b1-40a9-85ae-eb78a6daad11 None admin] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:47.484136 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce17beb-f0b1-40a9-85ae-eb78a6daad11 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:47.484405 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce17beb-f0b1-40a9-85ae-eb78a6daad11 None admin] PATH_INFO: `/v3/users` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:47.485108 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce17beb-f0b1-40a9-85ae-eb78a6daad11 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:47.486642 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce17beb-f0b1-40a9-85ae-eb78a6daad11 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:47.503113 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed6d9ca-10c2-468c-b94f-a8d1809496f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:21:47.509121 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application [None req-2ed6d9ca-10c2-468c-b94f-a8d1809496f0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 21:21:47.509121 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:21:47.509121 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:21:47.509121 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:21:47.509121 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:21:47.509121 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:21:47.509121 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:21:47.509121 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:21:47.509121 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:21:47.509121 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:21:47.509121 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:21:47.509121 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:21:47.509121 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:21:47.509121 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:21:47.509121 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:21:47.509121 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:21:47.510088 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:21:47.510088 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:21:47.510088 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:21:47.510088 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:21:47.510088 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:21:47.510088 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:21:47.510088 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:21:47.510088 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:21:47.510088 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:21:47.510088 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:21:47.510088 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:21:47.510088 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application with Lock( Jul 25 21:21:47.510088 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:21:47.510088 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:21:47.510088 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:21:47.510088 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:21:47.510932 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:21:47.510932 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:21:47.510932 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:21:47.510932 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:21:47.510932 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:21:47.510932 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:21:47.510932 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:21:47.510932 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:21:47.510932 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:21:47.510932 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:21:47.510932 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 21:21:47.510932 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Jul 25 21:21:47.510932 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 111/240] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Jul 25 21:21:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 21:21:47.522494 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 130/241] 10.222.0.66 () {60 vars in 1132 bytes} [Mon Jul 25 21:21:47 2022] POST /identity/v3/users => generated 293 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 21:21:47.531088 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed6d9ca-10c2-468c-b94f-a8d1809496f0 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:47.661499 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed6d9ca-10c2-468c-b94f-a8d1809496f0 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:47.669725 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:47.712734 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8e49a9-e575-4873-b1ee-dbf97593c181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:47.713324 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8e49a9-e575-4873-b1ee-dbf97593c181 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:47.713600 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8e49a9-e575-4873-b1ee-dbf97593c181 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:47.713870 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8e49a9-e575-4873-b1ee-dbf97593c181 None admin] PATH_INFO: `/v3/roles` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:47.714599 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8e49a9-e575-4873-b1ee-dbf97593c181 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:21:47.714897 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8e49a9-e575-4873-b1ee-dbf97593c181 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:47.716304 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8e49a9-e575-4873-b1ee-dbf97593c181 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:47.729949 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 112/242] 10.222.0.66 () {56 vars in 1101 bytes} [Mon Jul 25 21:21:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:21:47.735616 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce17beb-f0b1-40a9-85ae-eb78a6daad11 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:47.783665 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0129c626-a050-496a-9f72-ac6458f46914 None None] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:47.784029 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0129c626-a050-496a-9f72-ac6458f46914 None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:47.784206 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0129c626-a050-496a-9f72-ac6458f46914 None None] PATH_INFO: `/` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:47.785783 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 113/243] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:21:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 21:21:47.799299 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e27274e-a053-4ee8-be0b-786568c683eb None None] REQUEST_METHOD: `POST` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:47.799655 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e27274e-a053-4ee8-be0b-786568c683eb None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:47.799837 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e27274e-a053-4ee8-be0b-786568c683eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:47.821552 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.auth.core [None req-6e27274e-a053-4ee8-be0b-786568c683eb None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:21:47.822738 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.fernet_utils [None req-6e27274e-a053-4ee8-be0b-786568c683eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:21:47.825551 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:47.887743 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce17beb-f0b1-40a9-85ae-eb78a6daad11 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:47.916402 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 114/244] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:21:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jul 25 21:21:47.930891 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7397c3a7-a398-4d51-9933-9ddd9a9710e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:47.931553 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7397c3a7-a398-4d51-9933-9ddd9a9710e7 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:47.931829 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7397c3a7-a398-4d51-9933-9ddd9a9710e7 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:47.932105 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7397c3a7-a398-4d51-9933-9ddd9a9710e7 None admin] PATH_INFO: `/v3/users/6f5442aba941465fb2481a7a1f075d1f` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:47.944574 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e27274e-a053-4ee8-be0b-786568c683eb None None] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:47.953105 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7397c3a7-a398-4d51-9933-9ddd9a9710e7 None admin] RBAC: Authorizing `identity:get_user(user_id=6f5442aba941465fb2481a7a1f075d1f)` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:47.953105 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7397c3a7-a398-4d51-9933-9ddd9a9710e7 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:47.953105 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 131/245] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Jul 25 21:21:47 2022] GET /identity/v3/users/6f5442aba941465fb2481a7a1f075d1f => generated 297 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:21:47.965208 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7397c3a7-a398-4d51-9933-9ddd9a9710e7 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:48.052720 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:48.056630 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e27274e-a053-4ee8-be0b-786568c683eb None None] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:48.070279 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7397c3a7-a398-4d51-9933-9ddd9a9710e7 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:48.085398 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:48.094207 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4dad42-60da-4710-81bd-b245c75317e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:48.094997 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4dad42-60da-4710-81bd-b245c75317e9 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:48.095279 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4dad42-60da-4710-81bd-b245c75317e9 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:48.095646 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4dad42-60da-4710-81bd-b245c75317e9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:48.107848 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4dad42-60da-4710-81bd-b245c75317e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:21:48.111065 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082e6cff-4405-4465-9107-a48f5093e82a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:48.111974 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082e6cff-4405-4465-9107-a48f5093e82a None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:48.112435 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082e6cff-4405-4465-9107-a48f5093e82a None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:48.112869 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082e6cff-4405-4465-9107-a48f5093e82a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:48.113151 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application [None req-5c4dad42-60da-4710-81bd-b245c75317e9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 21:21:48.113151 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:21:48.113151 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:21:48.113151 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:21:48.113151 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:21:48.113151 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:21:48.113151 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:21:48.113151 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:21:48.113151 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:21:48.113151 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:21:48.113151 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:21:48.113151 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:21:48.113151 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:21:48.113151 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:21:48.113151 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:21:48.113151 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:21:48.114052 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:21:48.114052 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:21:48.114052 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:21:48.114052 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:21:48.114052 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:21:48.114052 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:21:48.114052 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:21:48.114052 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:21:48.114052 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:21:48.114052 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:21:48.114052 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:21:48.114052 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application with Lock( Jul 25 21:21:48.114052 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:21:48.114052 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:21:48.114052 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:21:48.114052 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:21:48.114918 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:21:48.114918 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:21:48.114918 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:21:48.114918 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:21:48.114918 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:21:48.114918 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:21:48.114918 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:21:48.114918 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:21:48.114918 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:21:48.114918 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:21:48.114918 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 21:21:48.114918 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Jul 25 21:21:48.119422 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 115/246] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Jul 25 21:21:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:21:48.121662 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4dad42-60da-4710-81bd-b245c75317e9 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:48.205817 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082e6cff-4405-4465-9107-a48f5093e82a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:48.207681 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082e6cff-4405-4465-9107-a48f5093e82a None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:48.259941 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4dad42-60da-4710-81bd-b245c75317e9 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:48.330348 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 132/247] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Jul 25 21:21:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 25 21:21:48.336474 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082e6cff-4405-4465-9107-a48f5093e82a None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:48.353144 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:48.442186 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1925b62-e33c-4d23-b47c-76a7f7b40ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:48.443066 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1925b62-e33c-4d23-b47c-76a7f7b40ab0 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:48.443342 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1925b62-e33c-4d23-b47c-76a7f7b40ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:48.443988 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1925b62-e33c-4d23-b47c-76a7f7b40ab0 None admin] PATH_INFO: `/v3/roles` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:48.444713 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1925b62-e33c-4d23-b47c-76a7f7b40ab0 None admin] RBAC: Adding query filter params (name=member) {{(pid=87210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:21:48.445010 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1925b62-e33c-4d23-b47c-76a7f7b40ab0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:48.447002 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1925b62-e33c-4d23-b47c-76a7f7b40ab0 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:48.458549 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 116/248] 10.222.0.66 () {56 vars in 1101 bytes} [Mon Jul 25 21:21:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:21:48.459834 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134a2f51-68af-462b-b02e-c44780c6b8bb None None] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:48.460118 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134a2f51-68af-462b-b02e-c44780c6b8bb None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:48.460390 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134a2f51-68af-462b-b02e-c44780c6b8bb None None] PATH_INFO: `/` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:48.461647 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 117/249] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:21:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:21:48.464113 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082e6cff-4405-4465-9107-a48f5093e82a None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:48.466023 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134a2f51-68af-462b-b02e-c44780c6b8bb None None] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:48.491978 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:48.512872 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7c4255-184c-4390-8323-597c2d189b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:48.513774 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7c4255-184c-4390-8323-597c2d189b09 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:48.514190 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7c4255-184c-4390-8323-597c2d189b09 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:48.514626 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7c4255-184c-4390-8323-597c2d189b09 None admin] PATH_INFO: `/v3/projects/75f1c39fe6504f958e7eea5381109120` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:48.516506 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7c4255-184c-4390-8323-597c2d189b09 None admin] RBAC: Authorizing `identity:get_project(project_id=75f1c39fe6504f958e7eea5381109120)` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:48.518366 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7c4255-184c-4390-8323-597c2d189b09 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:48.521458 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 133/250] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Jul 25 21:21:48 2022] GET /identity/v3/projects/75f1c39fe6504f958e7eea5381109120 => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:21:48.523196 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4423e358-39a6-4f69-a4e0-c8b3f349096b None None] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:48.523622 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4423e358-39a6-4f69-a4e0-c8b3f349096b None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:48.524282 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4423e358-39a6-4f69-a4e0-c8b3f349096b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:48.549814 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.auth.core [None req-4423e358-39a6-4f69-a4e0-c8b3f349096b None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:21:48.552376 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-4423e358-39a6-4f69-a4e0-c8b3f349096b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:21:48.613810 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134a2f51-68af-462b-b02e-c44780c6b8bb None None] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:48.635522 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 134/251] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:21:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:21:48.636671 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4423e358-39a6-4f69-a4e0-c8b3f349096b None None] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:48.650011 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:48.709821 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc39ec1d-e4e7-4c79-937d-2d2364e69625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:48.710493 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc39ec1d-e4e7-4c79-937d-2d2364e69625 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:48.710769 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc39ec1d-e4e7-4c79-937d-2d2364e69625 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:48.711036 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc39ec1d-e4e7-4c79-937d-2d2364e69625 None admin] PATH_INFO: `/v3/users/97d9cdca60ea4461a6a2e844e4807837` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:48.712242 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc39ec1d-e4e7-4c79-937d-2d2364e69625 None admin] RBAC: Authorizing `identity:get_user(user_id=97d9cdca60ea4461a6a2e844e4807837)` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:48.713734 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc39ec1d-e4e7-4c79-937d-2d2364e69625 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:48.720019 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 118/252] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Jul 25 21:21:48 2022] GET /identity/v3/users/97d9cdca60ea4461a6a2e844e4807837 => generated 297 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:21:48.721367 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc39ec1d-e4e7-4c79-937d-2d2364e69625 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:48.757263 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4423e358-39a6-4f69-a4e0-c8b3f349096b None None] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:48.794834 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1643fa58-c4b5-4aff-8aca-fae6496328f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:48.795477 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1643fa58-c4b5-4aff-8aca-fae6496328f6 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:48.795760 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1643fa58-c4b5-4aff-8aca-fae6496328f6 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:48.796035 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1643fa58-c4b5-4aff-8aca-fae6496328f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:48.796826 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1643fa58-c4b5-4aff-8aca-fae6496328f6 None admin] RBAC: Adding query filter params (role.id=ca991b54c98340d797cf644d4217dca9, scope.project.id=75f1c39fe6504f958e7eea5381109120, user.id=6f5442aba941465fb2481a7a1f075d1f) {{(pid=87209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:21:48.797149 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1643fa58-c4b5-4aff-8aca-fae6496328f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:48.798729 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1643fa58-c4b5-4aff-8aca-fae6496328f6 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:48.804992 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 135/253] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Jul 25 21:21:48 2022] GET /identity/v3/role_assignments?user.id=6f5442aba941465fb2481a7a1f075d1f&scope.project.id=75f1c39fe6504f958e7eea5381109120&role.id=ca991b54c98340d797cf644d4217dca9 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:21:48.805845 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1643fa58-c4b5-4aff-8aca-fae6496328f6 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:48.917458 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:48.924926 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:48.934626 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc39ec1d-e4e7-4c79-937d-2d2364e69625 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:48.967790 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1643fa58-c4b5-4aff-8aca-fae6496328f6 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:48.999350 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0e634e-b975-4e7c-991a-df193f922de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:49.000026 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0e634e-b975-4e7c-991a-df193f922de2 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:49.000308 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0e634e-b975-4e7c-991a-df193f922de2 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:49.000578 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0e634e-b975-4e7c-991a-df193f922de2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:49.030891 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55effead-25fb-4eeb-af01-1d16fc95d743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:49.031563 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55effead-25fb-4eeb-af01-1d16fc95d743 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:49.031844 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55effead-25fb-4eeb-af01-1d16fc95d743 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:49.032116 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55effead-25fb-4eeb-af01-1d16fc95d743 None admin] PATH_INFO: `/v3/projects/75f1c39fe6504f958e7eea5381109120` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:49.033850 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55effead-25fb-4eeb-af01-1d16fc95d743 None admin] RBAC: Authorizing `identity:get_project(project_id=75f1c39fe6504f958e7eea5381109120)` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:49.035343 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55effead-25fb-4eeb-af01-1d16fc95d743 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:49.037111 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 136/254] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Jul 25 21:21:48 2022] GET /identity/v3/projects/75f1c39fe6504f958e7eea5381109120 => generated 302 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:21:49.038461 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0e634e-b975-4e7c-991a-df193f922de2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:21:49.038773 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfcdce7-4be6-4cf0-a393-b9b29dbb74e8 None None] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:49.039058 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfcdce7-4be6-4cf0-a393-b9b29dbb74e8 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:49.039336 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfcdce7-4be6-4cf0-a393-b9b29dbb74e8 None None] PATH_INFO: `/` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:49.041234 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 137/255] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:21:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:21:49.046823 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ad4a4e-8bb9-406d-9c78-39ee9a98d188 None None] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:49.047080 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ad4a4e-8bb9-406d-9c78-39ee9a98d188 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:49.047299 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ad4a4e-8bb9-406d-9c78-39ee9a98d188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:49.048608 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application [None req-8e0e634e-b975-4e7c-991a-df193f922de2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 21:21:49.048608 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:21:49.048608 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:21:49.048608 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:21:49.048608 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:21:49.048608 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:21:49.048608 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:21:49.048608 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:21:49.048608 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:21:49.048608 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:21:49.048608 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:21:49.048608 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:21:49.048608 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:21:49.048608 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:21:49.048608 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:21:49.048608 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:21:49.049979 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:21:49.049979 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:21:49.049979 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:21:49.049979 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:21:49.049979 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:21:49.049979 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:21:49.049979 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:21:49.049979 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:21:49.049979 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:21:49.049979 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:21:49.049979 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:21:49.049979 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application with Lock( Jul 25 21:21:49.049979 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:21:49.049979 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:21:49.049979 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:21:49.049979 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:21:49.050756 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:21:49.050756 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:21:49.050756 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:21:49.050756 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:21:49.050756 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:21:49.050756 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:21:49.050756 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:21:49.050756 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:21:49.050756 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:21:49.050756 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:21:49.050756 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 21:21:49.050756 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Jul 25 21:21:49.057691 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 119/256] 10.222.0.66 () {56 vars in 1096 bytes} [Mon Jul 25 21:21:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:21:49.058797 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0e634e-b975-4e7c-991a-df193f922de2 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:49.068242 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.auth.core [None req-77ad4a4e-8bb9-406d-9c78-39ee9a98d188 None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:21:49.069557 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-77ad4a4e-8bb9-406d-9c78-39ee9a98d188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:21:49.147167 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 138/257] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:21:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 21:21:49.148183 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ad4a4e-8bb9-406d-9c78-39ee9a98d188 None None] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:49.257588 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:49.283529 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ad4a4e-8bb9-406d-9c78-39ee9a98d188 None None] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:49.321933 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4ab643-e67b-4615-898a-723fca14bf1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:49.322636 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4ab643-e67b-4615-898a-723fca14bf1d None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:49.322925 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4ab643-e67b-4615-898a-723fca14bf1d None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:49.323208 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4ab643-e67b-4615-898a-723fca14bf1d None admin] PATH_INFO: `/v3/roles` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:49.323941 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4ab643-e67b-4615-898a-723fca14bf1d None admin] RBAC: Adding query filter params (name=admin) {{(pid=87209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:21:49.324250 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4ab643-e67b-4615-898a-723fca14bf1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:49.325825 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4ab643-e67b-4615-898a-723fca14bf1d None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:49.335869 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 139/258] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Jul 25 21:21:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:21:49.336730 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4ab643-e67b-4615-898a-723fca14bf1d None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:49.392151 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0e634e-b975-4e7c-991a-df193f922de2 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:49.442621 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc23f9d-35e0-4917-8cce-ccad69274e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:49.443321 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc23f9d-35e0-4917-8cce-ccad69274e0e None admin] REQUEST_METHOD: `PUT` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:49.443604 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc23f9d-35e0-4917-8cce-ccad69274e0e None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:49.443883 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc23f9d-35e0-4917-8cce-ccad69274e0e None admin] PATH_INFO: `/v3/projects/75f1c39fe6504f958e7eea5381109120/users/97d9cdca60ea4461a6a2e844e4807837/roles/faec70ea0ba040efa587f542f054e49e` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:49.446052 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc23f9d-35e0-4917-8cce-ccad69274e0e None admin] RBAC: Authorizing `identity:create_grant(project_id=75f1c39fe6504f958e7eea5381109120, user_id=97d9cdca60ea4461a6a2e844e4807837, role_id=faec70ea0ba040efa587f542f054e49e)` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:49.447923 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc23f9d-35e0-4917-8cce-ccad69274e0e None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:49.464684 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 120/259] 10.222.0.66 () {58 vars in 1439 bytes} [Mon Jul 25 21:21:49 2022] PUT /identity/v3/projects/75f1c39fe6504f958e7eea5381109120/users/97d9cdca60ea4461a6a2e844e4807837/roles/faec70ea0ba040efa587f542f054e49e => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 21:21:49.465803 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc23f9d-35e0-4917-8cce-ccad69274e0e None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:49.480542 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:49.588921 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4ab643-e67b-4615-898a-723fca14bf1d None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:49.600260 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc23f9d-35e0-4917-8cce-ccad69274e0e None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:49.645840 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afad9c6-faa4-46c6-8a9b-eaf2e00f8a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:49.647582 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afad9c6-faa4-46c6-8a9b-eaf2e00f8a77 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:49.648032 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afad9c6-faa4-46c6-8a9b-eaf2e00f8a77 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:49.648454 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afad9c6-faa4-46c6-8a9b-eaf2e00f8a77 None admin] PATH_INFO: `/v3/users/610abf22584d4ed791ca4aa98301c7fe` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:49.650925 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afad9c6-faa4-46c6-8a9b-eaf2e00f8a77 None admin] RBAC: Authorizing `identity:get_user(user_id=610abf22584d4ed791ca4aa98301c7fe)` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:49.653788 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afad9c6-faa4-46c6-8a9b-eaf2e00f8a77 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:49.658251 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 121/260] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Jul 25 21:21:49 2022] GET /identity/v3/users/610abf22584d4ed791ca4aa98301c7fe => generated 283 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:21:49.667576 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afad9c6-faa4-46c6-8a9b-eaf2e00f8a77 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:49.676742 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fceeb3-61f0-4ec4-8094-44b45a322cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:49.681543 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fceeb3-61f0-4ec4-8094-44b45a322cc3 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:49.682030 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fceeb3-61f0-4ec4-8094-44b45a322cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:49.682481 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fceeb3-61f0-4ec4-8094-44b45a322cc3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:49.686974 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:49.713125 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fceeb3-61f0-4ec4-8094-44b45a322cc3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:21:49.720411 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application [None req-b3fceeb3-61f0-4ec4-8094-44b45a322cc3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 21:21:49.720411 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:21:49.720411 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:21:49.720411 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:21:49.720411 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:21:49.720411 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:21:49.720411 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:21:49.720411 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:21:49.720411 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:21:49.720411 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:21:49.720411 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:21:49.720411 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:21:49.720411 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:21:49.720411 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:21:49.720411 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:21:49.720411 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:21:49.721588 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:21:49.721588 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:21:49.721588 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:21:49.721588 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:21:49.721588 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:21:49.721588 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:21:49.721588 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:21:49.721588 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:21:49.721588 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:21:49.721588 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:21:49.721588 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:21:49.721588 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application with Lock( Jul 25 21:21:49.721588 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:21:49.721588 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:21:49.721588 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:21:49.721588 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:21:49.722430 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:21:49.722430 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:21:49.722430 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:21:49.722430 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:21:49.722430 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:21:49.722430 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:21:49.722430 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:21:49.722430 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:21:49.722430 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:21:49.722430 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:21:49.722430 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 21:21:49.722430 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Jul 25 21:21:49.725419 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 140/261] 10.222.0.66 () {56 vars in 1114 bytes} [Mon Jul 25 21:21:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 389 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:21:49.733357 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fceeb3-61f0-4ec4-8094-44b45a322cc3 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:49.795678 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:49.828780 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afad9c6-faa4-46c6-8a9b-eaf2e00f8a77 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:49.862222 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fceeb3-61f0-4ec4-8094-44b45a322cc3 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:49.888799 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774412c4-06de-4f26-8446-8ac2ec224db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:49.889553 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774412c4-06de-4f26-8446-8ac2ec224db4 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:49.889832 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774412c4-06de-4f26-8446-8ac2ec224db4 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:49.890098 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774412c4-06de-4f26-8446-8ac2ec224db4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:49.899911 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce41967-147d-4d6f-a360-dc5f3fa3ecd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:49.900775 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce41967-147d-4d6f-a360-dc5f3fa3ecd2 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:49.901245 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce41967-147d-4d6f-a360-dc5f3fa3ecd2 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:49.901654 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce41967-147d-4d6f-a360-dc5f3fa3ecd2 None admin] PATH_INFO: `/v3/roles` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:49.902513 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce41967-147d-4d6f-a360-dc5f3fa3ecd2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:21:49.903016 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce41967-147d-4d6f-a360-dc5f3fa3ecd2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:49.904598 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce41967-147d-4d6f-a360-dc5f3fa3ecd2 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:49.914368 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 141/262] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Jul 25 21:21:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:21:49.919944 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce41967-147d-4d6f-a360-dc5f3fa3ecd2 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:49.998931 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:50.009834 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774412c4-06de-4f26-8446-8ac2ec224db4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:50.011315 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774412c4-06de-4f26-8446-8ac2ec224db4 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:50.045806 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce41967-147d-4d6f-a360-dc5f3fa3ecd2 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:50.080846 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f3ff5e-0e0c-4b0b-b46c-76187a8b9ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:50.081532 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f3ff5e-0e0c-4b0b-b46c-76187a8b9ab6 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:50.081811 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f3ff5e-0e0c-4b0b-b46c-76187a8b9ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:50.082122 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f3ff5e-0e0c-4b0b-b46c-76187a8b9ab6 None admin] PATH_INFO: `/v3/users/610abf22584d4ed791ca4aa98301c7fe` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:50.083325 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f3ff5e-0e0c-4b0b-b46c-76187a8b9ab6 None admin] RBAC: Authorizing `identity:get_user(user_id=610abf22584d4ed791ca4aa98301c7fe)` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:50.084857 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f3ff5e-0e0c-4b0b-b46c-76187a8b9ab6 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:50.086560 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 142/263] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Jul 25 21:21:49 2022] GET /identity/v3/users/610abf22584d4ed791ca4aa98301c7fe => generated 283 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:21:50.092139 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f3ff5e-0e0c-4b0b-b46c-76187a8b9ab6 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:50.163502 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:50.204435 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 122/264] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Jul 25 21:21:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 537 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 21:21:50.210517 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774412c4-06de-4f26-8446-8ac2ec224db4 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:50.306235 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f3ff5e-0e0c-4b0b-b46c-76187a8b9ab6 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:50.349637 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:50.370154 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f1a37c-616d-4f5f-8ef9-90baf7c73b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:50.370796 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f1a37c-616d-4f5f-8ef9-90baf7c73b12 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:50.371075 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f1a37c-616d-4f5f-8ef9-90baf7c73b12 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:50.371346 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f1a37c-616d-4f5f-8ef9-90baf7c73b12 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:50.393302 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774412c4-06de-4f26-8446-8ac2ec224db4 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:50.456552 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6474197c-4f5b-4824-8fe8-76e02b5c5146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:50.457161 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6474197c-4f5b-4824-8fe8-76e02b5c5146 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:50.457448 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6474197c-4f5b-4824-8fe8-76e02b5c5146 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:50.457714 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6474197c-4f5b-4824-8fe8-76e02b5c5146 None admin] PATH_INFO: `/v3/projects/75f1c39fe6504f958e7eea5381109120` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:50.458896 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6474197c-4f5b-4824-8fe8-76e02b5c5146 None admin] RBAC: Authorizing `identity:get_project(project_id=75f1c39fe6504f958e7eea5381109120)` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:50.460354 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6474197c-4f5b-4824-8fe8-76e02b5c5146 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:50.463237 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 123/265] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Jul 25 21:21:50 2022] GET /identity/v3/projects/75f1c39fe6504f958e7eea5381109120 => generated 302 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:21:50.469290 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6474197c-4f5b-4824-8fe8-76e02b5c5146 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:50.545807 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:50.553996 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f1a37c-616d-4f5f-8ef9-90baf7c73b12 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:50.555504 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f1a37c-616d-4f5f-8ef9-90baf7c73b12 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:50.647295 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6474197c-4f5b-4824-8fe8-76e02b5c5146 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:50.705823 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc196497-6666-4347-8a1c-0ae1b86fd443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:50.706457 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc196497-6666-4347-8a1c-0ae1b86fd443 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:50.706792 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc196497-6666-4347-8a1c-0ae1b86fd443 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:50.706997 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc196497-6666-4347-8a1c-0ae1b86fd443 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:50.707790 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc196497-6666-4347-8a1c-0ae1b86fd443 None admin] RBAC: Adding query filter params (role.id=216a86497a3a4593ba08730ea8697df3, scope.project.id=75f1c39fe6504f958e7eea5381109120, user.id=610abf22584d4ed791ca4aa98301c7fe) {{(pid=87210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:21:50.708162 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc196497-6666-4347-8a1c-0ae1b86fd443 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:50.709663 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc196497-6666-4347-8a1c-0ae1b86fd443 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:50.719664 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 124/266] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Jul 25 21:21:50 2022] GET /identity/v3/role_assignments?user.id=610abf22584d4ed791ca4aa98301c7fe&scope.project.id=75f1c39fe6504f958e7eea5381109120&role.id=216a86497a3a4593ba08730ea8697df3 => generated 608 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:21:50.773006 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 143/267] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Jul 25 21:21:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 681 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 21:21:50.778755 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc196497-6666-4347-8a1c-0ae1b86fd443 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:50.906605 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc196497-6666-4347-8a1c-0ae1b86fd443 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:50.917521 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:50.952609 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23246bc-0534-4cb4-8667-c9b480602bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:50.953309 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23246bc-0534-4cb4-8667-c9b480602bdf None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:50.953588 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23246bc-0534-4cb4-8667-c9b480602bdf None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:50.953860 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23246bc-0534-4cb4-8667-c9b480602bdf None admin] PATH_INFO: `/v3/projects/75f1c39fe6504f958e7eea5381109120` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:50.955583 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23246bc-0534-4cb4-8667-c9b480602bdf None admin] RBAC: Authorizing `identity:get_project(project_id=75f1c39fe6504f958e7eea5381109120)` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:50.957207 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23246bc-0534-4cb4-8667-c9b480602bdf None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:50.960254 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 125/268] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Jul 25 21:21:50 2022] GET /identity/v3/projects/75f1c39fe6504f958e7eea5381109120 => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:21:50.965679 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f1a37c-616d-4f5f-8ef9-90baf7c73b12 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:51.031306 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:51.135966 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f1a37c-616d-4f5f-8ef9-90baf7c73b12 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:51.183621 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282e00f6-04f3-4362-9dd3-ced83e083c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:51.184638 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282e00f6-04f3-4362-9dd3-ced83e083c07 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:51.185157 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282e00f6-04f3-4362-9dd3-ced83e083c07 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:51.185622 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282e00f6-04f3-4362-9dd3-ced83e083c07 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:51.186600 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282e00f6-04f3-4362-9dd3-ced83e083c07 None admin] RBAC: Adding query filter params (role.id=f910595b432f450eb4b382e0c99cf932, scope.project.id=75f1c39fe6504f958e7eea5381109120, user.id=610abf22584d4ed791ca4aa98301c7fe) {{(pid=87209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:21:51.187097 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282e00f6-04f3-4362-9dd3-ced83e083c07 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:51.188735 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282e00f6-04f3-4362-9dd3-ced83e083c07 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:51.197714 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 144/269] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Jul 25 21:21:50 2022] GET /identity/v3/role_assignments?user.id=610abf22584d4ed791ca4aa98301c7fe&scope.project.id=75f1c39fe6504f958e7eea5381109120&role.id=f910595b432f450eb4b382e0c99cf932 => generated 608 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:21:51.251371 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203f5240-19d4-47e2-b513-60d345fa65e2 None None] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:51.251940 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203f5240-19d4-47e2-b513-60d345fa65e2 None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:51.251940 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203f5240-19d4-47e2-b513-60d345fa65e2 None None] PATH_INFO: `/` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:51.253851 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 126/270] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:21:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:21:51.259675 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cc1549-2c5f-430b-b7f4-74ae3b3ce725 None None] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:51.260160 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cc1549-2c5f-430b-b7f4-74ae3b3ce725 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:51.260581 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cc1549-2c5f-430b-b7f4-74ae3b3ce725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:51.288492 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.auth.core [None req-95cc1549-2c5f-430b-b7f4-74ae3b3ce725 None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:21:51.289794 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-95cc1549-2c5f-430b-b7f4-74ae3b3ce725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:21:51.374263 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 145/271] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:21:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:21:51.421786 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203f5240-19d4-47e2-b513-60d345fa65e2 None None] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:51.560051 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203f5240-19d4-47e2-b513-60d345fa65e2 None None] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:51.561472 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9178c71-23c5-4094-887e-9d9b5edfca09 None None] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:51.561758 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9178c71-23c5-4094-887e-9d9b5edfca09 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:51.562031 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9178c71-23c5-4094-887e-9d9b5edfca09 None None] PATH_INFO: `/` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:51.563658 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 146/272] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:21:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:21:51.569106 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4151ae8a-f049-4a61-a038-5756404f399b None None] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:51.569413 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4151ae8a-f049-4a61-a038-5756404f399b None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:51.569688 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4151ae8a-f049-4a61-a038-5756404f399b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:51.591506 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.auth.core [None req-4151ae8a-f049-4a61-a038-5756404f399b None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:21:51.592738 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-4151ae8a-f049-4a61-a038-5756404f399b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:21:51.609583 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:51.615631 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf33f90-6f0d-42f4-9bd3-771343c865b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:51.616302 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf33f90-6f0d-42f4-9bd3-771343c865b7 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:51.616581 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf33f90-6f0d-42f4-9bd3-771343c865b7 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:51.616858 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf33f90-6f0d-42f4-9bd3-771343c865b7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:51.635811 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf33f90-6f0d-42f4-9bd3-771343c865b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:21:51.641677 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application [None req-8cf33f90-6f0d-42f4-9bd3-771343c865b7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 21:21:51.641677 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:21:51.641677 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:21:51.641677 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:21:51.641677 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:21:51.641677 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:21:51.641677 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:21:51.641677 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:21:51.641677 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:21:51.641677 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:21:51.641677 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:21:51.641677 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:21:51.641677 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:21:51.641677 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:21:51.641677 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:21:51.641677 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:21:51.642752 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:21:51.642752 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:21:51.642752 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:21:51.642752 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:21:51.642752 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:21:51.642752 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:21:51.642752 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:21:51.642752 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:21:51.642752 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:21:51.642752 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:21:51.642752 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:21:51.642752 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application with Lock( Jul 25 21:21:51.642752 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:21:51.642752 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:21:51.642752 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:21:51.642752 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:21:51.643593 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:21:51.643593 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:21:51.643593 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:21:51.643593 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:21:51.643593 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:21:51.643593 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:21:51.643593 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:21:51.643593 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:21:51.643593 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:21:51.643593 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:21:51.643593 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 21:21:51.643593 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Jul 25 21:21:51.643593 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 127/273] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Jul 25 21:21:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:21:51.649446 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf33f90-6f0d-42f4-9bd3-771343c865b7 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:51.704068 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 147/274] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:21:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 21:21:51.717476 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:51.735190 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4151ae8a-f049-4a61-a038-5756404f399b None None] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:51.793322 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf33f90-6f0d-42f4-9bd3-771343c865b7 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:51.829937 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f62e9a-ab4d-47b3-abe3-45fb852fde1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:51.830729 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f62e9a-ab4d-47b3-abe3-45fb852fde1a None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:51.831150 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f62e9a-ab4d-47b3-abe3-45fb852fde1a None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:51.831431 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f62e9a-ab4d-47b3-abe3-45fb852fde1a None admin] PATH_INFO: `/v3/roles` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:51.832164 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f62e9a-ab4d-47b3-abe3-45fb852fde1a None admin] RBAC: Adding query filter params (name=member) {{(pid=87210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:21:51.832463 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f62e9a-ab4d-47b3-abe3-45fb852fde1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:51.833906 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f62e9a-ab4d-47b3-abe3-45fb852fde1a None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:51.842761 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 128/275] 10.222.0.66 () {56 vars in 1101 bytes} [Mon Jul 25 21:21:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:21:51.848871 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f62e9a-ab4d-47b3-abe3-45fb852fde1a None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:51.878702 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4151ae8a-f049-4a61-a038-5756404f399b None None] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:51.918934 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cdeec8-1faa-4b76-897c-b30f49a12628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:51.919596 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cdeec8-1faa-4b76-897c-b30f49a12628 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:51.919874 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cdeec8-1faa-4b76-897c-b30f49a12628 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:51.920147 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cdeec8-1faa-4b76-897c-b30f49a12628 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:51.921488 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cdeec8-1faa-4b76-897c-b30f49a12628 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:51.923088 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cdeec8-1faa-4b76-897c-b30f49a12628 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:51.924924 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 148/276] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 25 21:21:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:21:51.926004 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c304ac6e-46ce-467e-97c8-69840aba74ef None None] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:51.926287 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c304ac6e-46ce-467e-97c8-69840aba74ef None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:51.926557 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c304ac6e-46ce-467e-97c8-69840aba74ef None None] PATH_INFO: `/` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:51.932602 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 149/277] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:21:51 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:21:51.933466 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c304ac6e-46ce-467e-97c8-69840aba74ef None None] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:51.961388 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:51.968657 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:51.973760 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f62e9a-ab4d-47b3-abe3-45fb852fde1a None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:52.014983 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92f76bb-87de-4dc0-bac9-261b0d1498d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:52.015745 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92f76bb-87de-4dc0-bac9-261b0d1498d9 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:52.016098 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92f76bb-87de-4dc0-bac9-261b0d1498d9 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:52.016444 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92f76bb-87de-4dc0-bac9-261b0d1498d9 None admin] PATH_INFO: `/v3/users/18d589b133b640a4944461b7ad96ebaf` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:52.032226 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92f76bb-87de-4dc0-bac9-261b0d1498d9 None admin] RBAC: Authorizing `identity:get_user(user_id=18d589b133b640a4944461b7ad96ebaf)` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:52.034172 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92f76bb-87de-4dc0-bac9-261b0d1498d9 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:52.041070 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 129/278] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Jul 25 21:21:51 2022] GET /identity/v3/users/18d589b133b640a4944461b7ad96ebaf => generated 293 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:21:52.041070 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ed9aa-e543-4091-9d01-4f055c6718b9 None None] REQUEST_METHOD: `POST` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:52.041070 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ed9aa-e543-4091-9d01-4f055c6718b9 None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:52.041070 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ed9aa-e543-4091-9d01-4f055c6718b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:52.055748 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.auth.core [None req-a81ed9aa-e543-4091-9d01-4f055c6718b9 None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:21:52.056944 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.fernet_utils [None req-a81ed9aa-e543-4091-9d01-4f055c6718b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:21:52.059809 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c304ac6e-46ce-467e-97c8-69840aba74ef None None] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:52.096133 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393ae532-e224-438e-b03a-daae860f14da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:52.096764 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393ae532-e224-438e-b03a-daae860f14da None admin] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:52.097053 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393ae532-e224-438e-b03a-daae860f14da None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:52.097375 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393ae532-e224-438e-b03a-daae860f14da None admin] PATH_INFO: `/v3/users` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:52.098053 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393ae532-e224-438e-b03a-daae860f14da None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:52.099636 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393ae532-e224-438e-b03a-daae860f14da None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:52.133109 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 150/279] 10.222.0.66 () {60 vars in 1132 bytes} [Mon Jul 25 21:21:51 2022] POST /identity/v3/users => generated 293 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 21:21:52.133109 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393ae532-e224-438e-b03a-daae860f14da None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:52.149589 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 130/280] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:21:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:21:52.162743 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81ed9aa-e543-4091-9d01-4f055c6718b9 None None] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:52.220225 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:52.261017 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393ae532-e224-438e-b03a-daae860f14da None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:52.271865 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:52.290286 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81ed9aa-e543-4091-9d01-4f055c6718b9 None None] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:52.302735 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727058af-d2a0-4477-899a-c0601508e308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:52.303587 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727058af-d2a0-4477-899a-c0601508e308 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:52.303873 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727058af-d2a0-4477-899a-c0601508e308 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:52.304151 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727058af-d2a0-4477-899a-c0601508e308 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:52.305238 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727058af-d2a0-4477-899a-c0601508e308 None admin] RBAC: Adding query filter params (role.id=faec70ea0ba040efa587f542f054e49e, user.id=18d589b133b640a4944461b7ad96ebaf, scope.system=all) {{(pid=87209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:21:52.305554 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727058af-d2a0-4477-899a-c0601508e308 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:52.307058 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727058af-d2a0-4477-899a-c0601508e308 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:52.313434 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 151/281] 10.222.0.66 () {56 vars in 1308 bytes} [Mon Jul 25 21:21:52 2022] GET /identity/v3/role_assignments?user.id=18d589b133b640a4944461b7ad96ebaf&scope.system=all&role.id=faec70ea0ba040efa587f542f054e49e => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:21:52.332572 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a247d2cd-b3a9-4db7-92f8-dc6b7c95cf93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:52.333715 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a247d2cd-b3a9-4db7-92f8-dc6b7c95cf93 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:52.334191 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a247d2cd-b3a9-4db7-92f8-dc6b7c95cf93 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:52.334710 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a247d2cd-b3a9-4db7-92f8-dc6b7c95cf93 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:52.348712 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a247d2cd-b3a9-4db7-92f8-dc6b7c95cf93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:21:52.354232 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application [None req-a247d2cd-b3a9-4db7-92f8-dc6b7c95cf93 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 21:21:52.354232 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:21:52.354232 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:21:52.354232 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:21:52.354232 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:21:52.354232 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:21:52.354232 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:21:52.354232 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:21:52.354232 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:21:52.354232 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:21:52.354232 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:21:52.354232 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:21:52.354232 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:21:52.354232 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:21:52.354232 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:21:52.354232 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:21:52.355168 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:21:52.355168 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:21:52.355168 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:21:52.355168 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:21:52.355168 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:21:52.355168 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:21:52.355168 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:21:52.355168 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:21:52.355168 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:21:52.355168 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:21:52.355168 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:21:52.355168 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application with Lock( Jul 25 21:21:52.355168 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:21:52.355168 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:21:52.355168 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:21:52.355168 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:21:52.355946 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:21:52.355946 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:21:52.355946 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:21:52.355946 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:21:52.355946 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:21:52.355946 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:21:52.355946 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:21:52.355946 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:21:52.355946 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:21:52.355946 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:21:52.355946 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 21:21:52.355946 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Jul 25 21:21:52.358535 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 131/282] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Jul 25 21:21:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 21:21:52.365048 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727058af-d2a0-4477-899a-c0601508e308 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:52.486492 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727058af-d2a0-4477-899a-c0601508e308 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:52.525687 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cad5fe4-08bc-43f1-a2d8-e74857462ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:52.526323 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cad5fe4-08bc-43f1-a2d8-e74857462ae6 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:52.526600 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cad5fe4-08bc-43f1-a2d8-e74857462ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:52.526875 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cad5fe4-08bc-43f1-a2d8-e74857462ae6 None admin] PATH_INFO: `/v3/roles` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:52.527651 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cad5fe4-08bc-43f1-a2d8-e74857462ae6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:21:52.527956 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cad5fe4-08bc-43f1-a2d8-e74857462ae6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:52.529405 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cad5fe4-08bc-43f1-a2d8-e74857462ae6 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:52.531965 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:52.541525 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 152/283] 10.222.0.66 () {56 vars in 1101 bytes} [Mon Jul 25 21:21:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:21:52.547770 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a247d2cd-b3a9-4db7-92f8-dc6b7c95cf93 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:52.597929 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b608f1-0a52-4b1e-be83-b300fb491d72 None None] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:52.598263 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b608f1-0a52-4b1e-be83-b300fb491d72 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:52.598488 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b608f1-0a52-4b1e-be83-b300fb491d72 None None] PATH_INFO: `/` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:52.600269 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 153/284] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:21:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 21:21:52.605575 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2372ca97-8f4c-4073-9237-178bf37b511a None None] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:52.605861 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2372ca97-8f4c-4073-9237-178bf37b511a None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:52.606137 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2372ca97-8f4c-4073-9237-178bf37b511a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:52.625856 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.auth.core [None req-2372ca97-8f4c-4073-9237-178bf37b511a None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:21:52.627199 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-2372ca97-8f4c-4073-9237-178bf37b511a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:21:52.685229 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a247d2cd-b3a9-4db7-92f8-dc6b7c95cf93 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:52.711609 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 154/285] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:21:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 21:21:52.726891 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d015d1d-4cdf-41df-9c73-562cca8b9e0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:52.727564 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d015d1d-4cdf-41df-9c73-562cca8b9e0a None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:52.727847 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d015d1d-4cdf-41df-9c73-562cca8b9e0a None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:52.728126 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d015d1d-4cdf-41df-9c73-562cca8b9e0a None admin] PATH_INFO: `/v3/users/6f5442aba941465fb2481a7a1f075d1f` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:52.729418 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d015d1d-4cdf-41df-9c73-562cca8b9e0a None admin] RBAC: Authorizing `identity:get_user(user_id=6f5442aba941465fb2481a7a1f075d1f)` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:52.730988 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d015d1d-4cdf-41df-9c73-562cca8b9e0a None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:52.732817 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 132/286] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Jul 25 21:21:52 2022] GET /identity/v3/users/6f5442aba941465fb2481a7a1f075d1f => generated 297 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:21:52.738258 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2372ca97-8f4c-4073-9237-178bf37b511a None None] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:52.743049 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d015d1d-4cdf-41df-9c73-562cca8b9e0a None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:52.763857 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:52.873108 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d015d1d-4cdf-41df-9c73-562cca8b9e0a None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:52.873561 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2372ca97-8f4c-4073-9237-178bf37b511a None None] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:52.902761 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:52.911683 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adeaab6-b7ad-4ccd-a8e1-195554f25db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:52.912672 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adeaab6-b7ad-4ccd-a8e1-195554f25db2 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:52.913184 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adeaab6-b7ad-4ccd-a8e1-195554f25db2 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:52.913670 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adeaab6-b7ad-4ccd-a8e1-195554f25db2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:52.926235 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adeaab6-b7ad-4ccd-a8e1-195554f25db2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:21:52.932138 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application [None req-4adeaab6-b7ad-4ccd-a8e1-195554f25db2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 21:21:52.932138 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:21:52.932138 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:21:52.932138 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:21:52.932138 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:21:52.932138 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:21:52.932138 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:21:52.932138 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:21:52.932138 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:21:52.932138 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:21:52.932138 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:21:52.932138 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:21:52.932138 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:21:52.932138 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:21:52.932138 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:21:52.932138 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:21:52.933062 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:21:52.933062 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:21:52.933062 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:21:52.933062 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:21:52.933062 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:21:52.933062 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:21:52.933062 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:21:52.933062 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:21:52.933062 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:21:52.933062 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:21:52.933062 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:21:52.933062 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application with Lock( Jul 25 21:21:52.933062 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:21:52.933062 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:21:52.933062 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:21:52.933062 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:21:52.933880 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:21:52.933880 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:21:52.933880 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:21:52.933880 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:21:52.933880 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:21:52.933880 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:21:52.933880 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:21:52.933880 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:21:52.933880 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:21:52.933880 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:21:52.933880 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 21:21:52.933880 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Jul 25 21:21:52.935237 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 155/287] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Jul 25 21:21:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:21:52.941499 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adeaab6-b7ad-4ccd-a8e1-195554f25db2 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:52.950246 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca47e860-59cb-4c6f-bbbd-fb071c2c57d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:52.950945 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca47e860-59cb-4c6f-bbbd-fb071c2c57d7 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:52.951224 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca47e860-59cb-4c6f-bbbd-fb071c2c57d7 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:52.951495 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca47e860-59cb-4c6f-bbbd-fb071c2c57d7 None admin] PATH_INFO: `/v3/projects/75f1c39fe6504f958e7eea5381109120` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:52.952656 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca47e860-59cb-4c6f-bbbd-fb071c2c57d7 None admin] RBAC: Authorizing `identity:get_project(project_id=75f1c39fe6504f958e7eea5381109120)` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:52.954149 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca47e860-59cb-4c6f-bbbd-fb071c2c57d7 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:52.956263 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 133/288] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Jul 25 21:21:52 2022] GET /identity/v3/projects/75f1c39fe6504f958e7eea5381109120 => generated 302 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:21:52.962186 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca47e860-59cb-4c6f-bbbd-fb071c2c57d7 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:53.107323 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adeaab6-b7ad-4ccd-a8e1-195554f25db2 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:53.127534 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:53.153008 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a597be2-caf2-4ae8-a761-a549fdce47a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:53.154873 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a597be2-caf2-4ae8-a761-a549fdce47a8 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:53.155153 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a597be2-caf2-4ae8-a761-a549fdce47a8 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:53.155421 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a597be2-caf2-4ae8-a761-a549fdce47a8 None admin] PATH_INFO: `/v3/roles` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:53.156138 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a597be2-caf2-4ae8-a761-a549fdce47a8 None admin] RBAC: Adding query filter params (name=member) {{(pid=87209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:21:53.156438 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a597be2-caf2-4ae8-a761-a549fdce47a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:53.157888 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a597be2-caf2-4ae8-a761-a549fdce47a8 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:53.163237 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca47e860-59cb-4c6f-bbbd-fb071c2c57d7 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:53.180654 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 156/289] 10.222.0.66 () {56 vars in 1101 bytes} [Mon Jul 25 21:21:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:21:53.186135 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a597be2-caf2-4ae8-a761-a549fdce47a8 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:53.216432 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3c450a-8c45-4f17-b63d-e9bba370e9d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:53.217131 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3c450a-8c45-4f17-b63d-e9bba370e9d1 None admin] REQUEST_METHOD: `PUT` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:53.217471 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3c450a-8c45-4f17-b63d-e9bba370e9d1 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:53.217744 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3c450a-8c45-4f17-b63d-e9bba370e9d1 None admin] PATH_INFO: `/v3/projects/75f1c39fe6504f958e7eea5381109120/users/6f5442aba941465fb2481a7a1f075d1f/roles/ca991b54c98340d797cf644d4217dca9` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:53.219725 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3c450a-8c45-4f17-b63d-e9bba370e9d1 None admin] RBAC: Authorizing `identity:create_grant(project_id=75f1c39fe6504f958e7eea5381109120, user_id=6f5442aba941465fb2481a7a1f075d1f, role_id=ca991b54c98340d797cf644d4217dca9)` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:53.221277 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3c450a-8c45-4f17-b63d-e9bba370e9d1 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:53.248287 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 134/290] 10.222.0.66 () {58 vars in 1439 bytes} [Mon Jul 25 21:21:52 2022] PUT /identity/v3/projects/75f1c39fe6504f958e7eea5381109120/users/6f5442aba941465fb2481a7a1f075d1f/roles/ca991b54c98340d797cf644d4217dca9 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 21:21:53.277544 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:53.335600 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a597be2-caf2-4ae8-a761-a549fdce47a8 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:53.372682 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e99d518-1cfd-4f90-9b12-c726e8160a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:53.373403 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e99d518-1cfd-4f90-9b12-c726e8160a73 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:53.373684 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e99d518-1cfd-4f90-9b12-c726e8160a73 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:53.373958 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e99d518-1cfd-4f90-9b12-c726e8160a73 None admin] PATH_INFO: `/v3/users/97d9cdca60ea4461a6a2e844e4807837` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:53.375290 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e99d518-1cfd-4f90-9b12-c726e8160a73 None admin] RBAC: Authorizing `identity:get_user(user_id=97d9cdca60ea4461a6a2e844e4807837)` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:53.376944 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e99d518-1cfd-4f90-9b12-c726e8160a73 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:53.378693 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 157/291] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Jul 25 21:21:53 2022] GET /identity/v3/users/97d9cdca60ea4461a6a2e844e4807837 => generated 297 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:21:53.384616 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3c450a-8c45-4f17-b63d-e9bba370e9d1 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:53.497752 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3c450a-8c45-4f17-b63d-e9bba370e9d1 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:53.539031 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e96ab9-4d2b-4f47-9a29-b657737a5bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:53.539691 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e96ab9-4d2b-4f47-9a29-b657737a5bd5 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:53.540314 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e96ab9-4d2b-4f47-9a29-b657737a5bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:53.540584 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e96ab9-4d2b-4f47-9a29-b657737a5bd5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:53.555716 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:53.622525 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e96ab9-4d2b-4f47-9a29-b657737a5bd5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:53.624014 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e96ab9-4d2b-4f47-9a29-b657737a5bd5 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:53.735730 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 135/292] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Jul 25 21:21:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 21:21:53.741519 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e99d518-1cfd-4f90-9b12-c726e8160a73 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:53.850394 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e99d518-1cfd-4f90-9b12-c726e8160a73 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:53.868355 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:53.886281 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50ecd72-2d8c-48ac-bc55-23d91c6c0bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:53.886996 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50ecd72-2d8c-48ac-bc55-23d91c6c0bc7 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:53.887277 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50ecd72-2d8c-48ac-bc55-23d91c6c0bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:53.887552 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50ecd72-2d8c-48ac-bc55-23d91c6c0bc7 None admin] PATH_INFO: `/v3/projects/75f1c39fe6504f958e7eea5381109120` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:53.888731 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50ecd72-2d8c-48ac-bc55-23d91c6c0bc7 None admin] RBAC: Authorizing `identity:get_project(project_id=75f1c39fe6504f958e7eea5381109120)` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:53.890271 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50ecd72-2d8c-48ac-bc55-23d91c6c0bc7 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:53.892120 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 158/293] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Jul 25 21:21:53 2022] GET /identity/v3/projects/75f1c39fe6504f958e7eea5381109120 => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:21:53.898404 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e96ab9-4d2b-4f47-9a29-b657737a5bd5 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:53.946717 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:54.009114 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e96ab9-4d2b-4f47-9a29-b657737a5bd5 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:54.046793 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790d82e0-7a4a-46ca-9119-82ef4d737b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:54.047428 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790d82e0-7a4a-46ca-9119-82ef4d737b1b None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:54.047708 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790d82e0-7a4a-46ca-9119-82ef4d737b1b None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:54.047989 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790d82e0-7a4a-46ca-9119-82ef4d737b1b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:54.048890 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790d82e0-7a4a-46ca-9119-82ef4d737b1b None admin] RBAC: Adding query filter params (role.id=faec70ea0ba040efa587f542f054e49e, scope.project.id=75f1c39fe6504f958e7eea5381109120, user.id=97d9cdca60ea4461a6a2e844e4807837) {{(pid=87210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:21:54.049542 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790d82e0-7a4a-46ca-9119-82ef4d737b1b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:54.050972 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790d82e0-7a4a-46ca-9119-82ef4d737b1b None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:54.057337 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 136/294] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Jul 25 21:21:53 2022] GET /identity/v3/role_assignments?user.id=97d9cdca60ea4461a6a2e844e4807837&scope.project.id=75f1c39fe6504f958e7eea5381109120&role.id=faec70ea0ba040efa587f542f054e49e => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:21:54.933241 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8676de3f-c515-4759-a844-4d90a42c0b72 None None] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:54.933836 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8676de3f-c515-4759-a844-4d90a42c0b72 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:54.933836 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8676de3f-c515-4759-a844-4d90a42c0b72 None None] PATH_INFO: `/` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:54.935506 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 159/295] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:21:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:21:54.941783 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6242ece7-f084-49c0-b12a-3c2598fc6610 None None] REQUEST_METHOD: `POST` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:54.942316 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6242ece7-f084-49c0-b12a-3c2598fc6610 None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:54.942316 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6242ece7-f084-49c0-b12a-3c2598fc6610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:54.965179 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.auth.core [None req-6242ece7-f084-49c0-b12a-3c2598fc6610 None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:21:54.966445 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.fernet_utils [None req-6242ece7-f084-49c0-b12a-3c2598fc6610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:21:55.042285 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 137/296] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:21:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:21:55.066661 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8676de3f-c515-4759-a844-4d90a42c0b72 None None] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:55.073731 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69859c56-3530-4476-8340-c261860b78b1 None None] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:55.074266 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69859c56-3530-4476-8340-c261860b78b1 None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:55.074728 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69859c56-3530-4476-8340-c261860b78b1 None None] PATH_INFO: `/` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:55.076560 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 138/297] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:21:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:21:55.082289 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb060104-4e2b-49a2-af1a-440e16c3b0dd None None] REQUEST_METHOD: `POST` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:55.082819 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb060104-4e2b-49a2-af1a-440e16c3b0dd None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:55.083252 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb060104-4e2b-49a2-af1a-440e16c3b0dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:55.103392 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.auth.core [None req-bb060104-4e2b-49a2-af1a-440e16c3b0dd None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:21:55.104804 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.fernet_utils [None req-bb060104-4e2b-49a2-af1a-440e16c3b0dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:21:55.136432 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:55.177827 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 139/298] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:21:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 21:21:55.179314 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a73df77-589f-4244-9dc4-bc2fde9e546c None None] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:55.179596 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a73df77-589f-4244-9dc4-bc2fde9e546c None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:55.179863 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a73df77-589f-4244-9dc4-bc2fde9e546c None None] PATH_INFO: `/` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:55.181130 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 140/299] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:21:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:21:55.186507 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8415fd-4eb7-4881-a68d-7aef3af259c2 None None] REQUEST_METHOD: `POST` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:55.186716 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8415fd-4eb7-4881-a68d-7aef3af259c2 None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:55.186995 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8415fd-4eb7-4881-a68d-7aef3af259c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:55.189784 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8676de3f-c515-4759-a844-4d90a42c0b72 None None] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:55.205506 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.auth.core [None req-7a8415fd-4eb7-4881-a68d-7aef3af259c2 None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:21:55.206720 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.fernet_utils [None req-7a8415fd-4eb7-4881-a68d-7aef3af259c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:21:55.226824 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aec114-c82e-4522-89ea-dfbb8bbb7687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:55.227837 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aec114-c82e-4522-89ea-dfbb8bbb7687 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:55.228260 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aec114-c82e-4522-89ea-dfbb8bbb7687 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:55.228689 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aec114-c82e-4522-89ea-dfbb8bbb7687 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:55.239898 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0aec114-c82e-4522-89ea-dfbb8bbb7687 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:21:55.247141 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application [None req-c0aec114-c82e-4522-89ea-dfbb8bbb7687 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 21:21:55.247141 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:21:55.247141 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:21:55.247141 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:21:55.247141 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:21:55.247141 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:21:55.247141 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:21:55.247141 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:21:55.247141 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:21:55.247141 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:21:55.247141 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:21:55.247141 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:21:55.247141 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:21:55.247141 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:21:55.247141 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:21:55.247141 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:21:55.248049 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:21:55.248049 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:21:55.248049 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:21:55.248049 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:21:55.248049 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:21:55.248049 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:21:55.248049 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:21:55.248049 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:21:55.248049 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:21:55.248049 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:21:55.248049 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:21:55.248049 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application with Lock( Jul 25 21:21:55.248049 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:21:55.248049 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:21:55.248049 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:21:55.248049 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:21:55.254069 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:21:55.254069 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:21:55.254069 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:21:55.254069 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:21:55.254069 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:21:55.254069 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:21:55.254069 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:21:55.254069 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:21:55.254069 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:21:55.254069 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:21:55.254069 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 21:21:55.254069 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Jul 25 21:21:55.254069 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 160/300] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Jul 25 21:21:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:21:55.254069 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aec114-c82e-4522-89ea-dfbb8bbb7687 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:55.275077 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 141/301] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:21:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:21:55.276252 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8415fd-4eb7-4881-a68d-7aef3af259c2 None None] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:55.314884 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:55.371755 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aec114-c82e-4522-89ea-dfbb8bbb7687 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:55.378331 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:55.387060 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8415fd-4eb7-4881-a68d-7aef3af259c2 None None] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:55.409878 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8876f43-f219-49bb-b531-cf311cd4901c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:55.410946 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8876f43-f219-49bb-b531-cf311cd4901c None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:55.411231 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8876f43-f219-49bb-b531-cf311cd4901c None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:55.411509 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8876f43-f219-49bb-b531-cf311cd4901c None admin] PATH_INFO: `/v3/roles/member` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:55.425012 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8876f43-f219-49bb-b531-cf311cd4901c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:21:55.425423 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752dee36-3756-44ea-85c8-80b54222c591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:55.426126 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752dee36-3756-44ea-85c8-80b54222c591 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:55.426408 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752dee36-3756-44ea-85c8-80b54222c591 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:55.426752 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752dee36-3756-44ea-85c8-80b54222c591 None admin] PATH_INFO: `/v3/roles` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:55.427487 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752dee36-3756-44ea-85c8-80b54222c591 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:21:55.427793 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752dee36-3756-44ea-85c8-80b54222c591 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:55.429280 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752dee36-3756-44ea-85c8-80b54222c591 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:55.431236 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application [None req-e8876f43-f219-49bb-b531-cf311cd4901c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 21:21:55.431236 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:21:55.431236 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:21:55.431236 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:21:55.431236 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:21:55.431236 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:21:55.431236 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:21:55.431236 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:21:55.431236 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:21:55.431236 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:21:55.431236 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:21:55.431236 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:21:55.431236 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:21:55.431236 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:21:55.431236 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:21:55.431236 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:21:55.432072 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:21:55.432072 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:21:55.432072 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:21:55.432072 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:21:55.432072 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:21:55.432072 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:21:55.432072 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:21:55.432072 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:21:55.432072 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:21:55.432072 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:21:55.432072 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:21:55.432072 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application with Lock( Jul 25 21:21:55.432072 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:21:55.432072 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:21:55.432072 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:21:55.432072 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:21:55.432904 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:21:55.432904 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:21:55.432904 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:21:55.432904 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:21:55.432904 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:21:55.432904 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:21:55.432904 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:21:55.432904 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:21:55.432904 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:21:55.432904 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:21:55.432904 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 21:21:55.432904 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Jul 25 21:21:55.432904 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 161/302] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Jul 25 21:21:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:21:55.434551 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8876f43-f219-49bb-b531-cf311cd4901c None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:55.441644 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 142/303] 10.222.0.66 () {56 vars in 1101 bytes} [Mon Jul 25 21:21:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:21:55.442064 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752dee36-3756-44ea-85c8-80b54222c591 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:55.545568 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8876f43-f219-49bb-b531-cf311cd4901c None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:55.553548 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:55.561197 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752dee36-3756-44ea-85c8-80b54222c591 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:55.584625 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8645d83a-2425-49ce-81b9-d05d76603123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:55.585296 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8645d83a-2425-49ce-81b9-d05d76603123 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:55.585580 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8645d83a-2425-49ce-81b9-d05d76603123 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:55.585852 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8645d83a-2425-49ce-81b9-d05d76603123 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:55.587008 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8645d83a-2425-49ce-81b9-d05d76603123 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:55.588480 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8645d83a-2425-49ce-81b9-d05d76603123 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:55.590149 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 162/304] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 25 21:21:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:21:55.590955 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8645d83a-2425-49ce-81b9-d05d76603123 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:55.604939 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632ab0e8-f228-4b85-bcef-1b0f52467264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:55.605871 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632ab0e8-f228-4b85-bcef-1b0f52467264 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:55.606422 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632ab0e8-f228-4b85-bcef-1b0f52467264 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:55.606891 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632ab0e8-f228-4b85-bcef-1b0f52467264 None admin] PATH_INFO: `/v3/roles` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:55.607781 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632ab0e8-f228-4b85-bcef-1b0f52467264 None admin] RBAC: Adding query filter params (name=member) {{(pid=87210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:21:55.608153 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632ab0e8-f228-4b85-bcef-1b0f52467264 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:55.609641 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632ab0e8-f228-4b85-bcef-1b0f52467264 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:55.623899 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 143/305] 10.222.0.66 () {56 vars in 1101 bytes} [Mon Jul 25 21:21:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:21:55.623899 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632ab0e8-f228-4b85-bcef-1b0f52467264 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:55.646841 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:55.705449 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8645d83a-2425-49ce-81b9-d05d76603123 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:55.739335 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632ab0e8-f228-4b85-bcef-1b0f52467264 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:55.742852 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a4e385-db02-4c24-b432-cd4448030297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:55.743514 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a4e385-db02-4c24-b432-cd4448030297 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:55.743832 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a4e385-db02-4c24-b432-cd4448030297 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:55.744114 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a4e385-db02-4c24-b432-cd4448030297 None admin] PATH_INFO: `/v3/users/8f2ce01d1b574af19bf763919bc1d238` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:55.760740 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a4e385-db02-4c24-b432-cd4448030297 None admin] RBAC: Authorizing `identity:get_user(user_id=8f2ce01d1b574af19bf763919bc1d238)` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:55.762735 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a4e385-db02-4c24-b432-cd4448030297 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:55.769915 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 163/306] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Jul 25 21:21:55 2022] GET /identity/v3/users/8f2ce01d1b574af19bf763919bc1d238 => generated 293 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:21:55.769915 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a4e385-db02-4c24-b432-cd4448030297 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:55.774729 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4feae9a-70f1-45a1-b66b-be09b7983665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:55.775371 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4feae9a-70f1-45a1-b66b-be09b7983665 None admin] REQUEST_METHOD: `POST` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:55.775652 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4feae9a-70f1-45a1-b66b-be09b7983665 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:55.775926 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4feae9a-70f1-45a1-b66b-be09b7983665 None admin] PATH_INFO: `/v3/groups` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:55.776594 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4feae9a-70f1-45a1-b66b-be09b7983665 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:55.778103 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4feae9a-70f1-45a1-b66b-be09b7983665 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:55.805111 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 144/307] 10.222.0.66 () {60 vars in 1134 bytes} [Mon Jul 25 21:21:55 2022] POST /identity/v3/groups => generated 229 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 21:21:55.805111 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4feae9a-70f1-45a1-b66b-be09b7983665 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:55.810103 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:55.891608 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a4e385-db02-4c24-b432-cd4448030297 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:55.905585 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:55.936748 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4feae9a-70f1-45a1-b66b-be09b7983665 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:55.938571 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e022989-63ed-4c2f-80fb-610be3cee60d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:55.940210 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e022989-63ed-4c2f-80fb-610be3cee60d None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:55.940751 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e022989-63ed-4c2f-80fb-610be3cee60d None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:55.941026 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e022989-63ed-4c2f-80fb-610be3cee60d None admin] PATH_INFO: `/v3/users/18d589b133b640a4944461b7ad96ebaf` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:55.947910 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e022989-63ed-4c2f-80fb-610be3cee60d None admin] RBAC: Authorizing `identity:get_user(user_id=18d589b133b640a4944461b7ad96ebaf)` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:55.949444 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e022989-63ed-4c2f-80fb-610be3cee60d None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:55.951315 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 164/308] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Jul 25 21:21:55 2022] GET /identity/v3/users/18d589b133b640a4944461b7ad96ebaf => generated 293 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:21:55.957888 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e022989-63ed-4c2f-80fb-610be3cee60d None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:55.984676 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f48be8-53e3-4468-9eb1-51eb9fe8372c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:55.986166 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f48be8-53e3-4468-9eb1-51eb9fe8372c None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:55.986866 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f48be8-53e3-4468-9eb1-51eb9fe8372c None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:55.987552 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f48be8-53e3-4468-9eb1-51eb9fe8372c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:55.988638 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f48be8-53e3-4468-9eb1-51eb9fe8372c None admin] RBAC: Adding query filter params (role.id=ca991b54c98340d797cf644d4217dca9, user.id=8f2ce01d1b574af19bf763919bc1d238, scope.system=all) {{(pid=87210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:21:55.989183 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f48be8-53e3-4468-9eb1-51eb9fe8372c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:55.990953 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f48be8-53e3-4468-9eb1-51eb9fe8372c None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:55.997628 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 145/309] 10.222.0.66 () {56 vars in 1308 bytes} [Mon Jul 25 21:21:55 2022] GET /identity/v3/role_assignments?user.id=8f2ce01d1b574af19bf763919bc1d238&scope.system=all&role.id=ca991b54c98340d797cf644d4217dca9 => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:21:56.078162 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a23c66-a2d9-4a4b-89f9-839da23ef8fd None None] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:56.078379 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a23c66-a2d9-4a4b-89f9-839da23ef8fd None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:56.078628 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a23c66-a2d9-4a4b-89f9-839da23ef8fd None None] PATH_INFO: `/` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:56.080158 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 146/310] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:21:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 21:21:56.085825 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb0a3aa-91b4-4d70-9f57-6144503ae536 None None] REQUEST_METHOD: `POST` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:56.086132 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb0a3aa-91b4-4d70-9f57-6144503ae536 None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:56.086378 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb0a3aa-91b4-4d70-9f57-6144503ae536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:56.107536 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.auth.core [None req-8cb0a3aa-91b4-4d70-9f57-6144503ae536 None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:21:56.108774 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.fernet_utils [None req-8cb0a3aa-91b4-4d70-9f57-6144503ae536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:21:56.120324 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:56.126434 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e022989-63ed-4c2f-80fb-610be3cee60d None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:56.187496 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f0a312-c317-4cf4-9507-5748058d3c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:56.188177 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f0a312-c317-4cf4-9507-5748058d3c40 None admin] REQUEST_METHOD: `PUT` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:56.188451 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f0a312-c317-4cf4-9507-5748058d3c40 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:56.188715 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f0a312-c317-4cf4-9507-5748058d3c40 None admin] PATH_INFO: `/v3/system/users/18d589b133b640a4944461b7ad96ebaf/roles/faec70ea0ba040efa587f542f054e49e` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:56.190776 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f0a312-c317-4cf4-9507-5748058d3c40 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=18d589b133b640a4944461b7ad96ebaf, role_id=faec70ea0ba040efa587f542f054e49e)` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:56.192184 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f0a312-c317-4cf4-9507-5748058d3c40 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:56.205681 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 165/312] 10.222.0.66 () {58 vars in 1334 bytes} [Mon Jul 25 21:21:55 2022] PUT /identity/v3/system/users/18d589b133b640a4944461b7ad96ebaf/roles/faec70ea0ba040efa587f542f054e49e => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 21:21:56.213281 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 147/312] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:21:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 21:21:56.230823 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f0a312-c317-4cf4-9507-5748058d3c40 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:56.352587 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f0a312-c317-4cf4-9507-5748058d3c40 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:56.391730 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d453ff73-b9e1-46fb-a45d-275919aa1a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:56.393302 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d453ff73-b9e1-46fb-a45d-275919aa1a78 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:56.393680 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d453ff73-b9e1-46fb-a45d-275919aa1a78 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:56.393972 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d453ff73-b9e1-46fb-a45d-275919aa1a78 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:56.405797 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d453ff73-b9e1-46fb-a45d-275919aa1a78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:21:56.411828 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application [None req-d453ff73-b9e1-46fb-a45d-275919aa1a78 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 21:21:56.411828 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:21:56.411828 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:21:56.411828 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:21:56.411828 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:21:56.411828 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:21:56.411828 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:21:56.411828 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:21:56.411828 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:21:56.411828 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:21:56.411828 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:21:56.411828 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:21:56.411828 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:21:56.411828 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:21:56.411828 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:21:56.411828 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:21:56.412715 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:21:56.412715 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:21:56.412715 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:21:56.412715 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:21:56.412715 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:21:56.412715 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:21:56.412715 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:21:56.412715 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:21:56.412715 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:21:56.412715 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:21:56.412715 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:21:56.412715 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application with Lock( Jul 25 21:21:56.412715 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:21:56.412715 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:21:56.412715 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:21:56.412715 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:21:56.413546 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:21:56.413546 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:21:56.413546 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:21:56.413546 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:21:56.413546 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:21:56.413546 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:21:56.413546 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:21:56.413546 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:21:56.413546 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:21:56.413546 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:21:56.413546 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 21:21:56.413546 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Jul 25 21:21:56.413546 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 166/313] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Jul 25 21:21:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:21:56.419641 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb0a3aa-91b4-4d70-9f57-6144503ae536 None None] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:56.509256 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:56.536636 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb0a3aa-91b4-4d70-9f57-6144503ae536 None None] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:56.571570 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e39042-6ed1-4f83-bb89-90c6e8a9eb97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:56.572501 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e39042-6ed1-4f83-bb89-90c6e8a9eb97 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:56.572952 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e39042-6ed1-4f83-bb89-90c6e8a9eb97 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:56.573465 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e39042-6ed1-4f83-bb89-90c6e8a9eb97 None admin] PATH_INFO: `/v3/roles` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:56.574734 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e39042-6ed1-4f83-bb89-90c6e8a9eb97 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:21:56.575211 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e39042-6ed1-4f83-bb89-90c6e8a9eb97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:56.577017 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e39042-6ed1-4f83-bb89-90c6e8a9eb97 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:56.586997 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 148/314] 10.222.0.66 () {56 vars in 1101 bytes} [Mon Jul 25 21:21:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:21:56.592853 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d453ff73-b9e1-46fb-a45d-275919aa1a78 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:56.625537 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:56.700240 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d453ff73-b9e1-46fb-a45d-275919aa1a78 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:56.735875 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251e30d6-7792-422c-b6f6-a80f2c09282c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:56.736957 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251e30d6-7792-422c-b6f6-a80f2c09282c None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:56.737749 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251e30d6-7792-422c-b6f6-a80f2c09282c None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:56.738432 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251e30d6-7792-422c-b6f6-a80f2c09282c None admin] PATH_INFO: `/v3/users/6f5442aba941465fb2481a7a1f075d1f` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:56.740699 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251e30d6-7792-422c-b6f6-a80f2c09282c None admin] RBAC: Authorizing `identity:get_user(user_id=6f5442aba941465fb2481a7a1f075d1f)` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:56.742544 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251e30d6-7792-422c-b6f6-a80f2c09282c None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:56.744685 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 167/315] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Jul 25 21:21:56 2022] GET /identity/v3/users/6f5442aba941465fb2481a7a1f075d1f => generated 297 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:21:56.750531 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e39042-6ed1-4f83-bb89-90c6e8a9eb97 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:56.853290 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e39042-6ed1-4f83-bb89-90c6e8a9eb97 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:56.886890 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0370686-deab-41bd-8b05-fb0ef957fb32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:56.887791 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0370686-deab-41bd-8b05-fb0ef957fb32 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:56.888246 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0370686-deab-41bd-8b05-fb0ef957fb32 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:56.888686 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0370686-deab-41bd-8b05-fb0ef957fb32 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:56.892548 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:56.961416 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0370686-deab-41bd-8b05-fb0ef957fb32 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:56.962896 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0370686-deab-41bd-8b05-fb0ef957fb32 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:57.067703 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 149/316] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Jul 25 21:21:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 21:21:57.073459 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251e30d6-7792-422c-b6f6-a80f2c09282c None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:57.169751 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:57.189211 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251e30d6-7792-422c-b6f6-a80f2c09282c None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:57.227768 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f68abf-abfd-43f8-9d72-e16e567b09de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:57.228437 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f68abf-abfd-43f8-9d72-e16e567b09de None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:57.228716 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f68abf-abfd-43f8-9d72-e16e567b09de None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:57.228987 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f68abf-abfd-43f8-9d72-e16e567b09de None admin] PATH_INFO: `/v3/projects/75f1c39fe6504f958e7eea5381109120` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:57.230192 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f68abf-abfd-43f8-9d72-e16e567b09de None admin] RBAC: Authorizing `identity:get_project(project_id=75f1c39fe6504f958e7eea5381109120)` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:57.231661 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f68abf-abfd-43f8-9d72-e16e567b09de None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:57.233602 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 168/317] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Jul 25 21:21:57 2022] GET /identity/v3/projects/75f1c39fe6504f958e7eea5381109120 => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:21:57.239800 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0370686-deab-41bd-8b05-fb0ef957fb32 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:57.276065 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:57.345503 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0370686-deab-41bd-8b05-fb0ef957fb32 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:57.379772 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f752ad-990e-4cad-8db6-129d27e3e620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:57.380399 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f752ad-990e-4cad-8db6-129d27e3e620 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:57.380676 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f752ad-990e-4cad-8db6-129d27e3e620 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:57.380950 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f752ad-990e-4cad-8db6-129d27e3e620 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:57.381772 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f752ad-990e-4cad-8db6-129d27e3e620 None admin] RBAC: Adding query filter params (role.id=ca991b54c98340d797cf644d4217dca9, scope.project.id=75f1c39fe6504f958e7eea5381109120, user.id=6f5442aba941465fb2481a7a1f075d1f) {{(pid=87210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:21:57.382074 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f752ad-990e-4cad-8db6-129d27e3e620 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:57.383521 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f752ad-990e-4cad-8db6-129d27e3e620 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:57.389680 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 150/318] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Jul 25 21:21:57 2022] GET /identity/v3/role_assignments?user.id=6f5442aba941465fb2481a7a1f075d1f&scope.project.id=75f1c39fe6504f958e7eea5381109120&role.id=ca991b54c98340d797cf644d4217dca9 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:21:58.274278 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9607f8-40eb-4406-90ea-49e1ac1aaefe None None] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:58.274787 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9607f8-40eb-4406-90ea-49e1ac1aaefe None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:58.274787 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9607f8-40eb-4406-90ea-49e1ac1aaefe None None] PATH_INFO: `/` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:58.276048 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 169/319] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:21:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:21:58.281467 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fd88e2-5f72-4e79-8f2c-e90cc724b41a None None] REQUEST_METHOD: `POST` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:58.281937 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fd88e2-5f72-4e79-8f2c-e90cc724b41a None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:58.282012 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fd88e2-5f72-4e79-8f2c-e90cc724b41a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:58.301037 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.auth.core [None req-b1fd88e2-5f72-4e79-8f2c-e90cc724b41a None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:21:58.302267 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.fernet_utils [None req-b1fd88e2-5f72-4e79-8f2c-e90cc724b41a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:21:58.319627 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd47cb9-b654-4030-b38f-677edc48dda8 None None] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:58.319905 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd47cb9-b654-4030-b38f-677edc48dda8 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:58.320164 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd47cb9-b654-4030-b38f-677edc48dda8 None None] PATH_INFO: `/` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:58.321714 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 170/320] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:21:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:21:58.326441 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b63eef-ecf1-473d-8fc3-8246788305c8 None None] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:58.326738 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b63eef-ecf1-473d-8fc3-8246788305c8 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:58.327009 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b63eef-ecf1-473d-8fc3-8246788305c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:58.344866 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.auth.core [None req-b6b63eef-ecf1-473d-8fc3-8246788305c8 None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:21:58.347074 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-b6b63eef-ecf1-473d-8fc3-8246788305c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:21:58.385313 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 151/321] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:21:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:21:58.408396 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fd88e2-5f72-4e79-8f2c-e90cc724b41a None None] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:58.429448 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 171/322] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:21:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 21:21:58.443541 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:58.453618 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b63eef-ecf1-473d-8fc3-8246788305c8 None None] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:58.519641 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fd88e2-5f72-4e79-8f2c-e90cc724b41a None None] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:58.555478 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:58.561020 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd88a0d6-2562-4050-ae7f-753074aa4e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:58.562222 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd88a0d6-2562-4050-ae7f-753074aa4e96 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:58.562699 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd88a0d6-2562-4050-ae7f-753074aa4e96 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:58.563428 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd88a0d6-2562-4050-ae7f-753074aa4e96 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:58.564980 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd88a0d6-2562-4050-ae7f-753074aa4e96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:58.566249 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b63eef-ecf1-473d-8fc3-8246788305c8 None None] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:58.566442 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd88a0d6-2562-4050-ae7f-753074aa4e96 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:58.568212 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 152/323] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 25 21:21:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:21:58.573538 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd88a0d6-2562-4050-ae7f-753074aa4e96 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:58.604024 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a16fd1f-2891-49ef-9a9c-63f26b740a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:58.604673 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a16fd1f-2891-49ef-9a9c-63f26b740a4a None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:58.604947 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a16fd1f-2891-49ef-9a9c-63f26b740a4a None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:58.605258 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a16fd1f-2891-49ef-9a9c-63f26b740a4a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:58.615547 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a16fd1f-2891-49ef-9a9c-63f26b740a4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:21:58.620537 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application [None req-9a16fd1f-2891-49ef-9a9c-63f26b740a4a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 21:21:58.620537 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:21:58.620537 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:21:58.620537 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:21:58.620537 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:21:58.620537 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:21:58.620537 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:21:58.620537 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:21:58.620537 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:21:58.620537 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:21:58.620537 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:21:58.620537 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:21:58.620537 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:21:58.620537 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:21:58.620537 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:21:58.620537 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:21:58.621667 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:21:58.621667 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:21:58.621667 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:21:58.621667 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:21:58.621667 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:21:58.621667 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:21:58.621667 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:21:58.621667 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:21:58.621667 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:21:58.621667 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:21:58.621667 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:21:58.621667 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application with Lock( Jul 25 21:21:58.621667 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:21:58.621667 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:21:58.621667 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:21:58.621667 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:21:58.622851 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:21:58.622851 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:21:58.622851 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:21:58.622851 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:21:58.622851 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:21:58.622851 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:21:58.622851 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:21:58.622851 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:21:58.622851 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:21:58.622851 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:21:58.622851 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 21:21:58.622851 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Jul 25 21:21:58.622851 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 172/324] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Jul 25 21:21:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 21:21:58.623700 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb20c6e-401e-44d1-85b4-f95f1b359dd8 None None] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:58.623700 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb20c6e-401e-44d1-85b4-f95f1b359dd8 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:58.623823 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb20c6e-401e-44d1-85b4-f95f1b359dd8 None None] PATH_INFO: `/` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:58.624990 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 173/325] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:21:58 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:21:58.627772 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb20c6e-401e-44d1-85b4-f95f1b359dd8 None None] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:58.679955 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:58.683734 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd88a0d6-2562-4050-ae7f-753074aa4e96 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:58.719093 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8758aab7-99a4-4c07-8dfa-ea84d2b67e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:58.719734 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8758aab7-99a4-4c07-8dfa-ea84d2b67e0d None admin] REQUEST_METHOD: `POST` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:58.720015 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8758aab7-99a4-4c07-8dfa-ea84d2b67e0d None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:58.720285 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8758aab7-99a4-4c07-8dfa-ea84d2b67e0d None admin] PATH_INFO: `/v3/groups` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:58.721393 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8758aab7-99a4-4c07-8dfa-ea84d2b67e0d None admin] RBAC: Authorizing `identity:create_group()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:58.722874 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8758aab7-99a4-4c07-8dfa-ea84d2b67e0d None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:58.734445 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb20c6e-401e-44d1-85b4-f95f1b359dd8 None None] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:58.738793 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 153/326] 10.222.0.66 () {60 vars in 1134 bytes} [Mon Jul 25 21:21:58 2022] POST /identity/v3/groups => generated 226 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 21:21:58.742626 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb6547f-761c-4498-8267-b2eb315f7e93 None None] REQUEST_METHOD: `POST` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:58.743060 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb6547f-761c-4498-8267-b2eb315f7e93 None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:58.743361 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb6547f-761c-4498-8267-b2eb315f7e93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:58.764537 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.auth.core [None req-efb6547f-761c-4498-8267-b2eb315f7e93 None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:21:58.765817 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.fernet_utils [None req-efb6547f-761c-4498-8267-b2eb315f7e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:21:58.778520 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1bf918-9e9e-409f-a12a-a99bde290cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:58.779632 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1bf918-9e9e-409f-a12a-a99bde290cc6 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:58.780204 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1bf918-9e9e-409f-a12a-a99bde290cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:58.780722 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1bf918-9e9e-409f-a12a-a99bde290cc6 None admin] PATH_INFO: `/v3/roles` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:58.781722 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1bf918-9e9e-409f-a12a-a99bde290cc6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:21:58.782318 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1bf918-9e9e-409f-a12a-a99bde290cc6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:58.784175 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1bf918-9e9e-409f-a12a-a99bde290cc6 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:58.798918 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 174/327] 10.222.0.66 () {56 vars in 1101 bytes} [Mon Jul 25 21:21:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:21:58.800818 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1bf918-9e9e-409f-a12a-a99bde290cc6 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:58.820864 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:58.843483 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 154/328] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:21:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:21:58.868614 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb6547f-761c-4498-8267-b2eb315f7e93 None None] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:58.922842 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1bf918-9e9e-409f-a12a-a99bde290cc6 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:58.961131 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0d6335-700e-4e2d-a48d-f19d3846ee14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:58.961426 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0d6335-700e-4e2d-a48d-f19d3846ee14 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:58.961705 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0d6335-700e-4e2d-a48d-f19d3846ee14 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:58.961980 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0d6335-700e-4e2d-a48d-f19d3846ee14 None admin] PATH_INFO: `/v3/users/8f2ce01d1b574af19bf763919bc1d238` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:58.963289 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0d6335-700e-4e2d-a48d-f19d3846ee14 None admin] RBAC: Authorizing `identity:get_user(user_id=8f2ce01d1b574af19bf763919bc1d238)` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:58.964834 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0d6335-700e-4e2d-a48d-f19d3846ee14 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:58.966812 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 175/329] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Jul 25 21:21:58 2022] GET /identity/v3/users/8f2ce01d1b574af19bf763919bc1d238 => generated 293 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:21:58.972307 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0d6335-700e-4e2d-a48d-f19d3846ee14 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:58.981360 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:58.995857 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb6547f-761c-4498-8267-b2eb315f7e93 None None] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:59.043248 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfbffb9-6c04-404d-b579-d04d62c1f69c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:59.043913 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfbffb9-6c04-404d-b579-d04d62c1f69c None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:59.044191 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfbffb9-6c04-404d-b579-d04d62c1f69c None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:59.044460 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfbffb9-6c04-404d-b579-d04d62c1f69c None admin] PATH_INFO: `/v3/roles/member` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:59.055315 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfbffb9-6c04-404d-b579-d04d62c1f69c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:21:59.060411 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application [None req-5cfbffb9-6c04-404d-b579-d04d62c1f69c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 21:21:59.060411 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:21:59.060411 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:21:59.060411 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:21:59.060411 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:21:59.060411 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:21:59.060411 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:21:59.060411 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:21:59.060411 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:21:59.060411 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:21:59.060411 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:21:59.060411 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:21:59.060411 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:21:59.060411 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:21:59.060411 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:21:59.060411 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:21:59.061458 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:21:59.061458 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:21:59.061458 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:21:59.061458 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:21:59.061458 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:21:59.061458 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:21:59.061458 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:21:59.061458 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:21:59.061458 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:21:59.061458 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:21:59.061458 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:21:59.061458 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application with Lock( Jul 25 21:21:59.061458 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:21:59.061458 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:21:59.061458 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:21:59.061458 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:21:59.062416 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:21:59.062416 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:21:59.062416 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:21:59.062416 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:21:59.062416 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:21:59.062416 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:21:59.062416 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:21:59.062416 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:21:59.062416 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:21:59.062416 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:21:59.062416 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 21:21:59.062416 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Jul 25 21:21:59.062416 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 155/330] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Jul 25 21:21:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:21:59.068092 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfbffb9-6c04-404d-b579-d04d62c1f69c None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:59.080183 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:59.104755 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0d6335-700e-4e2d-a48d-f19d3846ee14 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:59.142767 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3012ca2e-6967-454b-a082-e884e31d0c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:59.143945 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3012ca2e-6967-454b-a082-e884e31d0c22 None admin] REQUEST_METHOD: `PUT` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:59.144426 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3012ca2e-6967-454b-a082-e884e31d0c22 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:59.145047 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3012ca2e-6967-454b-a082-e884e31d0c22 None admin] PATH_INFO: `/v3/system/users/8f2ce01d1b574af19bf763919bc1d238/roles/ca991b54c98340d797cf644d4217dca9` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:59.147772 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3012ca2e-6967-454b-a082-e884e31d0c22 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=8f2ce01d1b574af19bf763919bc1d238, role_id=ca991b54c98340d797cf644d4217dca9)` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:59.149480 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3012ca2e-6967-454b-a082-e884e31d0c22 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:59.159465 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 176/331] 10.222.0.66 () {58 vars in 1334 bytes} [Mon Jul 25 21:21:58 2022] PUT /identity/v3/system/users/8f2ce01d1b574af19bf763919bc1d238/roles/ca991b54c98340d797cf644d4217dca9 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 21:21:59.195919 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfbffb9-6c04-404d-b579-d04d62c1f69c None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:59.234995 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd34a17-34fb-46e8-87a1-09bdfd279985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:59.235788 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd34a17-34fb-46e8-87a1-09bdfd279985 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:59.236280 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd34a17-34fb-46e8-87a1-09bdfd279985 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:59.236711 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd34a17-34fb-46e8-87a1-09bdfd279985 None admin] PATH_INFO: `/v3/roles` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:59.237665 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd34a17-34fb-46e8-87a1-09bdfd279985 None admin] RBAC: Adding query filter params (name=member) {{(pid=87210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:21:59.238064 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd34a17-34fb-46e8-87a1-09bdfd279985 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:59.239600 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd34a17-34fb-46e8-87a1-09bdfd279985 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:59.253240 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 156/332] 10.222.0.66 () {56 vars in 1101 bytes} [Mon Jul 25 21:21:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:21:59.260598 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3012ca2e-6967-454b-a082-e884e31d0c22 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:59.387710 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3012ca2e-6967-454b-a082-e884e31d0c22 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:59.425941 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e811bf1e-646f-404f-986a-a88eb1c9f69f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:59.426602 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e811bf1e-646f-404f-986a-a88eb1c9f69f None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:59.426879 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e811bf1e-646f-404f-986a-a88eb1c9f69f None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:59.427151 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e811bf1e-646f-404f-986a-a88eb1c9f69f None admin] PATH_INFO: `/v3/users/18d589b133b640a4944461b7ad96ebaf` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:59.428341 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e811bf1e-646f-404f-986a-a88eb1c9f69f None admin] RBAC: Authorizing `identity:get_user(user_id=18d589b133b640a4944461b7ad96ebaf)` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:59.429916 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e811bf1e-646f-404f-986a-a88eb1c9f69f None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:59.431624 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 177/333] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Jul 25 21:21:59 2022] GET /identity/v3/users/18d589b133b640a4944461b7ad96ebaf => generated 293 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:21:59.437494 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd34a17-34fb-46e8-87a1-09bdfd279985 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:21:59.452845 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:59.568743 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd34a17-34fb-46e8-87a1-09bdfd279985 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:21:59.611879 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e32ffe-1c33-45d6-9c10-c8556712c09c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:21:59.612999 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e32ffe-1c33-45d6-9c10-c8556712c09c None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:21:59.613518 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e32ffe-1c33-45d6-9c10-c8556712c09c None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:21:59.614014 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e32ffe-1c33-45d6-9c10-c8556712c09c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:21:59.615009 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e32ffe-1c33-45d6-9c10-c8556712c09c None admin] RBAC: Adding query filter params (role.id=faec70ea0ba040efa587f542f054e49e, user.id=18d589b133b640a4944461b7ad96ebaf, scope.system=all) {{(pid=87210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:21:59.615516 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e32ffe-1c33-45d6-9c10-c8556712c09c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:21:59.617239 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e32ffe-1c33-45d6-9c10-c8556712c09c None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:21:59.636014 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 157/334] 10.222.0.66 () {56 vars in 1308 bytes} [Mon Jul 25 21:21:59 2022] GET /identity/v3/role_assignments?user.id=18d589b133b640a4944461b7ad96ebaf&scope.system=all&role.id=faec70ea0ba040efa587f542f054e49e => generated 510 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:01.436361 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70891c8-a0e5-4b82-98c4-efce82f56e8c None None] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:01.436892 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70891c8-a0e5-4b82-98c4-efce82f56e8c None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:01.436892 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70891c8-a0e5-4b82-98c4-efce82f56e8c None None] PATH_INFO: `/` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:01.438604 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 178/335] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:22:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:22:01.444751 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d1a8d1-de93-4b8e-bafb-74a2ae85ab21 None None] REQUEST_METHOD: `POST` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:01.445243 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d1a8d1-de93-4b8e-bafb-74a2ae85ab21 None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:01.445327 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d1a8d1-de93-4b8e-bafb-74a2ae85ab21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:01.469951 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.auth.core [None req-51d1a8d1-de93-4b8e-bafb-74a2ae85ab21 None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:22:01.471443 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.fernet_utils [None req-51d1a8d1-de93-4b8e-bafb-74a2ae85ab21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:22:01.548219 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:01.555227 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 158/336] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:22:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:22:01.599511 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70891c8-a0e5-4b82-98c4-efce82f56e8c None None] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:01.616749 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:01.674520 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f83e8bd-6dcb-4494-9e7f-f15d8f297185 None None] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:01.675255 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f83e8bd-6dcb-4494-9e7f-f15d8f297185 None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:01.675746 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f83e8bd-6dcb-4494-9e7f-f15d8f297185 None None] PATH_INFO: `/` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:01.678264 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 159/337] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:22:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:22:01.686525 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae488a-bf90-4ba5-85e8-025d9ba07afc None None] REQUEST_METHOD: `POST` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:01.687088 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae488a-bf90-4ba5-85e8-025d9ba07afc None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:01.687558 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae488a-bf90-4ba5-85e8-025d9ba07afc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:01.722403 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.auth.core [None req-2fae488a-bf90-4ba5-85e8-025d9ba07afc None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:22:01.723893 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.fernet_utils [None req-2fae488a-bf90-4ba5-85e8-025d9ba07afc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:22:01.734725 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70891c8-a0e5-4b82-98c4-efce82f56e8c None None] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:01.805822 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6968aa-44bd-4eac-b413-9816e2892caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:01.806633 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6968aa-44bd-4eac-b413-9816e2892caf None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:01.806921 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6968aa-44bd-4eac-b413-9816e2892caf None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:01.807194 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6968aa-44bd-4eac-b413-9816e2892caf None admin] PATH_INFO: `/v3/roles/member` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:01.830238 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6968aa-44bd-4eac-b413-9816e2892caf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:22:01.835963 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application [None req-dc6968aa-44bd-4eac-b413-9816e2892caf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 21:22:01.835963 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:22:01.835963 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:22:01.835963 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:22:01.835963 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:22:01.835963 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:22:01.835963 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:22:01.835963 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:22:01.835963 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:22:01.835963 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:22:01.835963 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:22:01.835963 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:22:01.835963 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:22:01.835963 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:22:01.835963 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:22:01.835963 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:22:01.836837 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:22:01.836837 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:22:01.836837 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:22:01.836837 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:22:01.836837 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:22:01.836837 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:22:01.836837 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:22:01.836837 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:22:01.836837 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:22:01.836837 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:22:01.836837 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:22:01.836837 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application with Lock( Jul 25 21:22:01.836837 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:22:01.836837 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:22:01.836837 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:22:01.836837 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:22:01.837652 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:22:01.837652 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:22:01.837652 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:22:01.837652 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:22:01.837652 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:22:01.837652 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:22:01.837652 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:22:01.837652 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:22:01.837652 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:22:01.837652 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:22:01.837652 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 21:22:01.837652 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Jul 25 21:22:01.837652 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 179/338] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Jul 25 21:22:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:22:01.844252 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6968aa-44bd-4eac-b413-9816e2892caf None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:01.858639 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 160/339] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:22:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 21:22:01.903645 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fae488a-bf90-4ba5-85e8-025d9ba07afc None None] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:02.003334 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:02.062026 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6968aa-44bd-4eac-b413-9816e2892caf None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:02.119931 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fae488a-bf90-4ba5-85e8-025d9ba07afc None None] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:02.135753 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7239b7f3-fd49-466e-8591-32d3f8f52363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:02.136760 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7239b7f3-fd49-466e-8591-32d3f8f52363 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:02.137284 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7239b7f3-fd49-466e-8591-32d3f8f52363 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:02.137746 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7239b7f3-fd49-466e-8591-32d3f8f52363 None admin] PATH_INFO: `/v3/roles` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:02.138662 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7239b7f3-fd49-466e-8591-32d3f8f52363 None admin] RBAC: Adding query filter params (name=member) {{(pid=87209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:02.145541 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7239b7f3-fd49-466e-8591-32d3f8f52363 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:02.147023 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7239b7f3-fd49-466e-8591-32d3f8f52363 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:02.162360 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:02.163741 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 180/340] 10.222.0.66 () {56 vars in 1101 bytes} [Mon Jul 25 21:22:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:22:02.169497 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7239b7f3-fd49-466e-8591-32d3f8f52363 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:02.176171 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7c09b6-ca55-4783-ad21-2c2c06a7dc04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:02.176925 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7c09b6-ca55-4783-ad21-2c2c06a7dc04 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:02.177416 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7c09b6-ca55-4783-ad21-2c2c06a7dc04 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:02.177752 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7c09b6-ca55-4783-ad21-2c2c06a7dc04 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:02.189642 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7c09b6-ca55-4783-ad21-2c2c06a7dc04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:22:02.198302 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application [None req-7d7c09b6-ca55-4783-ad21-2c2c06a7dc04 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 21:22:02.198302 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:22:02.198302 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:22:02.198302 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:22:02.198302 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:22:02.198302 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:22:02.198302 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:22:02.198302 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:22:02.198302 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:22:02.198302 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:22:02.198302 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:22:02.198302 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:22:02.198302 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:22:02.198302 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:22:02.198302 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:22:02.198302 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:22:02.199387 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:22:02.199387 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:22:02.199387 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:22:02.199387 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:22:02.199387 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:22:02.199387 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:22:02.199387 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:22:02.199387 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:22:02.199387 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:22:02.199387 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:22:02.199387 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:22:02.199387 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application with Lock( Jul 25 21:22:02.199387 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:22:02.199387 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:22:02.199387 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:22:02.199387 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:22:02.200172 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:22:02.200172 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:22:02.200172 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:22:02.200172 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:22:02.200172 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:22:02.200172 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:22:02.200172 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:22:02.200172 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:22:02.200172 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:22:02.200172 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:22:02.200172 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 21:22:02.200172 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Jul 25 21:22:02.202536 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 161/341] 10.222.0.66 () {56 vars in 1114 bytes} [Mon Jul 25 21:22:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:22:02.208710 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7c09b6-ca55-4783-ad21-2c2c06a7dc04 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:02.417531 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7c09b6-ca55-4783-ad21-2c2c06a7dc04 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:02.419691 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7239b7f3-fd49-466e-8591-32d3f8f52363 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:02.461846 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c9cbb4-b16e-4304-951a-c4d78171b5cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:02.465058 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c9cbb4-b16e-4304-951a-c4d78171b5cd None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:02.465365 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c9cbb4-b16e-4304-951a-c4d78171b5cd None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:02.465635 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c9cbb4-b16e-4304-951a-c4d78171b5cd None admin] PATH_INFO: `/v3/roles` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:02.466360 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c9cbb4-b16e-4304-951a-c4d78171b5cd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:02.466663 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c9cbb4-b16e-4304-951a-c4d78171b5cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:02.468078 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c9cbb4-b16e-4304-951a-c4d78171b5cd None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:02.484962 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 162/342] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Jul 25 21:22:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:22:02.488351 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d258b68f-0365-4e47-a207-b034d894eba0 None None] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:02.488639 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d258b68f-0365-4e47-a207-b034d894eba0 None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:02.488900 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d258b68f-0365-4e47-a207-b034d894eba0 None None] PATH_INFO: `/` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:02.490197 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 163/343] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:22:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:22:02.497021 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d258b68f-0365-4e47-a207-b034d894eba0 None None] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:02.512010 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1cea7b-85d3-416d-b68e-a26198ab695b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:02.513462 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1cea7b-85d3-416d-b68e-a26198ab695b None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:02.513954 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1cea7b-85d3-416d-b68e-a26198ab695b None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:02.514423 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1cea7b-85d3-416d-b68e-a26198ab695b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:02.524026 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:02.602198 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1cea7b-85d3-416d-b68e-a26198ab695b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:02.602418 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:02.604160 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1cea7b-85d3-416d-b68e-a26198ab695b None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:02.711379 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 181/344] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Jul 25 21:22:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 542 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 21:22:02.713057 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7fe4bc-ed2f-4ff1-b3c8-761a30f0d917 None None] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:02.717892 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7fe4bc-ed2f-4ff1-b3c8-761a30f0d917 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:02.718412 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7fe4bc-ed2f-4ff1-b3c8-761a30f0d917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:02.722090 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d258b68f-0365-4e47-a207-b034d894eba0 None None] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:02.738480 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.auth.core [None req-4b7fe4bc-ed2f-4ff1-b3c8-761a30f0d917 None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:22:02.740031 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-4b7fe4bc-ed2f-4ff1-b3c8-761a30f0d917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:22:02.769208 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5e729e-eda5-4263-a220-7079842da0d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:02.769948 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:02.770706 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5e729e-eda5-4263-a220-7079842da0d5 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:02.771220 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5e729e-eda5-4263-a220-7079842da0d5 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:02.771713 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5e729e-eda5-4263-a220-7079842da0d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:02.813627 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 182/345] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:22:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:22:02.814470 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7fe4bc-ed2f-4ff1-b3c8-761a30f0d917 None None] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:02.856755 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5e729e-eda5-4263-a220-7079842da0d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:02.858513 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5e729e-eda5-4263-a220-7079842da0d5 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:02.921579 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:02.953757 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7fe4bc-ed2f-4ff1-b3c8-761a30f0d917 None None] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:02.990549 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 164/346] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Jul 25 21:22:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 21:22:02.992900 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa37e736-98b5-4f86-b285-7c8a9ff72aaf None None] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:02.993514 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa37e736-98b5-4f86-b285-7c8a9ff72aaf None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:02.993979 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa37e736-98b5-4f86-b285-7c8a9ff72aaf None None] PATH_INFO: `/` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:02.995750 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 165/347] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:22:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:22:02.996650 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa37e736-98b5-4f86-b285-7c8a9ff72aaf None None] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:03.001218 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487c75cc-0d55-42ad-b866-93ccf84c52d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:03.002069 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487c75cc-0d55-42ad-b866-93ccf84c52d7 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:03.002417 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487c75cc-0d55-42ad-b866-93ccf84c52d7 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:03.002724 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487c75cc-0d55-42ad-b866-93ccf84c52d7 None admin] PATH_INFO: `/v3/projects/d8086440d31c4402a8800ca68927d7e1` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:03.003910 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487c75cc-0d55-42ad-b866-93ccf84c52d7 None admin] RBAC: Authorizing `identity:get_project(project_id=d8086440d31c4402a8800ca68927d7e1)` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:03.005749 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487c75cc-0d55-42ad-b866-93ccf84c52d7 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:03.008263 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 183/348] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Jul 25 21:22:02 2022] GET /identity/v3/projects/d8086440d31c4402a8800ca68927d7e1 => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:03.009041 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487c75cc-0d55-42ad-b866-93ccf84c52d7 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:03.048282 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:03.132284 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487c75cc-0d55-42ad-b866-93ccf84c52d7 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:03.138275 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa37e736-98b5-4f86-b285-7c8a9ff72aaf None None] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:03.178963 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94591a21-1b30-4182-9ef2-e4b26bad3a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:03.180088 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94591a21-1b30-4182-9ef2-e4b26bad3a90 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:03.180559 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94591a21-1b30-4182-9ef2-e4b26bad3a90 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:03.181037 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94591a21-1b30-4182-9ef2-e4b26bad3a90 None admin] PATH_INFO: `/v3/projects/d8086440d31c4402a8800ca68927d7e1` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:03.183065 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94591a21-1b30-4182-9ef2-e4b26bad3a90 None admin] RBAC: Authorizing `identity:get_project(project_id=d8086440d31c4402a8800ca68927d7e1)` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:03.183752 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d034e0b-308c-4d12-82b1-9372b9963d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:03.184419 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d034e0b-308c-4d12-82b1-9372b9963d2a None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:03.184716 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d034e0b-308c-4d12-82b1-9372b9963d2a None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:03.184971 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d034e0b-308c-4d12-82b1-9372b9963d2a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:03.185687 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94591a21-1b30-4182-9ef2-e4b26bad3a90 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:03.187691 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 184/349] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Jul 25 21:22:03 2022] GET /identity/v3/projects/d8086440d31c4402a8800ca68927d7e1 => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:03.189248 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1a4e94-c6a0-4390-ac66-c6638cf366c7 None None] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:03.189878 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1a4e94-c6a0-4390-ac66-c6638cf366c7 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:03.190409 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1a4e94-c6a0-4390-ac66-c6638cf366c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:03.206062 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d034e0b-308c-4d12-82b1-9372b9963d2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:22:03.213003 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application [None req-3d034e0b-308c-4d12-82b1-9372b9963d2a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 21:22:03.213003 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:22:03.213003 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:22:03.213003 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:22:03.213003 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:22:03.213003 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:22:03.213003 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:22:03.213003 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:22:03.213003 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:22:03.213003 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:22:03.213003 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:22:03.213003 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:22:03.213003 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:22:03.213003 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:22:03.213003 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:22:03.213003 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:22:03.213972 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:22:03.213972 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:22:03.213972 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:22:03.213972 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:22:03.213972 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:22:03.213972 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:22:03.213972 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:22:03.213972 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:22:03.213972 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:22:03.213972 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:22:03.213972 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:22:03.213972 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application with Lock( Jul 25 21:22:03.213972 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:22:03.213972 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:22:03.213972 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:22:03.213972 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:22:03.214801 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:22:03.214801 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:22:03.214801 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:22:03.214801 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:22:03.214801 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:22:03.214801 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:22:03.214801 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:22:03.214801 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:22:03.214801 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:22:03.214801 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:22:03.214801 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 21:22:03.214801 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Jul 25 21:22:03.215412 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.auth.core [None req-5d1a4e94-c6a0-4390-ac66-c6638cf366c7 None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:22:03.215412 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-5d1a4e94-c6a0-4390-ac66-c6638cf366c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:22:03.217762 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 166/350] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Jul 25 21:22:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:22:03.218939 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d034e0b-308c-4d12-82b1-9372b9963d2a None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:03.235697 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:03.299188 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 185/351] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:22:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:22:03.302324 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1a4e94-c6a0-4390-ac66-c6638cf366c7 None None] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:03.342435 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:03.356384 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d034e0b-308c-4d12-82b1-9372b9963d2a None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:03.397478 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81e051d-17e9-4d19-a418-f9e055baa253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:03.398548 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81e051d-17e9-4d19-a418-f9e055baa253 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:03.399056 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81e051d-17e9-4d19-a418-f9e055baa253 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:03.399714 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81e051d-17e9-4d19-a418-f9e055baa253 None admin] PATH_INFO: `/v3/groups/2767cb4da7664937aadecafa78377ea5` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:03.406463 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81e051d-17e9-4d19-a418-f9e055baa253 None admin] RBAC: Authorizing `identity:get_group(group_id=2767cb4da7664937aadecafa78377ea5)` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:03.410444 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81e051d-17e9-4d19-a418-f9e055baa253 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:03.412864 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 167/352] 10.222.0.66 () {56 vars in 1180 bytes} [Mon Jul 25 21:22:03 2022] GET /identity/v3/groups/2767cb4da7664937aadecafa78377ea5 => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:03.414620 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81e051d-17e9-4d19-a418-f9e055baa253 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:03.433906 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1a4e94-c6a0-4390-ac66-c6638cf366c7 None None] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:03.476950 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112dfc49-c297-41c6-86c3-b91b88c72bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:03.478089 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112dfc49-c297-41c6-86c3-b91b88c72bfa None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:03.478561 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112dfc49-c297-41c6-86c3-b91b88c72bfa None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:03.479033 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112dfc49-c297-41c6-86c3-b91b88c72bfa None admin] PATH_INFO: `/v3/groups/2767cb4da7664937aadecafa78377ea5` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:03.482586 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112dfc49-c297-41c6-86c3-b91b88c72bfa None admin] RBAC: Authorizing `identity:get_group(group_id=2767cb4da7664937aadecafa78377ea5)` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:03.484622 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112dfc49-c297-41c6-86c3-b91b88c72bfa None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:03.487006 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 186/353] 10.222.0.66 () {56 vars in 1180 bytes} [Mon Jul 25 21:22:03 2022] GET /identity/v3/groups/2767cb4da7664937aadecafa78377ea5 => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:03.488116 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112dfc49-c297-41c6-86c3-b91b88c72bfa None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:03.525214 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:03.567975 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81e051d-17e9-4d19-a418-f9e055baa253 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:03.615874 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee34348-f27b-4389-bbd9-91d36770c5c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:03.616521 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee34348-f27b-4389-bbd9-91d36770c5c6 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:03.616832 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee34348-f27b-4389-bbd9-91d36770c5c6 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:03.618019 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee34348-f27b-4389-bbd9-91d36770c5c6 None admin] PATH_INFO: `/v3/roles` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:03.618275 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee34348-f27b-4389-bbd9-91d36770c5c6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:03.618585 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee34348-f27b-4389-bbd9-91d36770c5c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:03.619989 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee34348-f27b-4389-bbd9-91d36770c5c6 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:03.632351 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:03.632859 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 168/354] 10.222.0.66 () {56 vars in 1101 bytes} [Mon Jul 25 21:22:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:03.634060 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee34348-f27b-4389-bbd9-91d36770c5c6 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:03.638729 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112dfc49-c297-41c6-86c3-b91b88c72bfa None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:03.679690 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3981e99b-99d9-4540-ad4a-1366b933846a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:03.680772 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3981e99b-99d9-4540-ad4a-1366b933846a None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:03.681325 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3981e99b-99d9-4540-ad4a-1366b933846a None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:03.681808 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3981e99b-99d9-4540-ad4a-1366b933846a None admin] PATH_INFO: `/v3/roles/member` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:03.699078 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3981e99b-99d9-4540-ad4a-1366b933846a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:22:03.708128 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application [None req-3981e99b-99d9-4540-ad4a-1366b933846a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 21:22:03.708128 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:22:03.708128 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:22:03.708128 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:22:03.708128 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:22:03.708128 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:22:03.708128 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:22:03.708128 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:22:03.708128 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:22:03.708128 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:22:03.708128 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:22:03.708128 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:22:03.708128 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:22:03.708128 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:22:03.708128 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:22:03.708128 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:22:03.709072 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:22:03.709072 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:22:03.709072 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:22:03.709072 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:22:03.709072 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:22:03.709072 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:22:03.709072 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:22:03.709072 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:22:03.709072 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:22:03.709072 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:22:03.709072 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:22:03.709072 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application with Lock( Jul 25 21:22:03.709072 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:22:03.709072 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:22:03.709072 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:22:03.709072 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:22:03.710185 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:22:03.710185 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:22:03.710185 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:22:03.710185 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:22:03.710185 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:22:03.710185 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:22:03.710185 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:22:03.710185 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:22:03.710185 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:22:03.710185 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:22:03.710185 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 21:22:03.710185 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Jul 25 21:22:03.710185 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 187/355] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Jul 25 21:22:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:22:03.710185 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3981e99b-99d9-4540-ad4a-1366b933846a None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:03.773503 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee34348-f27b-4389-bbd9-91d36770c5c6 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:03.815844 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61c6613-22a6-4ebe-9bac-d528ae38b114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:03.816484 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61c6613-22a6-4ebe-9bac-d528ae38b114 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:03.816766 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61c6613-22a6-4ebe-9bac-d528ae38b114 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:03.817031 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61c6613-22a6-4ebe-9bac-d528ae38b114 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:03.817927 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61c6613-22a6-4ebe-9bac-d528ae38b114 None admin] RBAC: Adding query filter params (group.id=2767cb4da7664937aadecafa78377ea5, role.id=faec70ea0ba040efa587f542f054e49e, scope.project.id=d8086440d31c4402a8800ca68927d7e1) {{(pid=87210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:03.818292 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61c6613-22a6-4ebe-9bac-d528ae38b114 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:03.819729 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61c6613-22a6-4ebe-9bac-d528ae38b114 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:03.828187 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:03.833572 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 169/356] 10.222.0.66 () {56 vars in 1376 bytes} [Mon Jul 25 21:22:03 2022] GET /identity/v3/role_assignments?group.id=2767cb4da7664937aadecafa78377ea5&scope.project.id=d8086440d31c4402a8800ca68927d7e1&role.id=faec70ea0ba040efa587f542f054e49e => generated 260 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:03.834498 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61c6613-22a6-4ebe-9bac-d528ae38b114 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:03.873528 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3981e99b-99d9-4540-ad4a-1366b933846a None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:03.929884 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b375ee7b-8fc5-4cbe-bc77-1fdc0251d88c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:03.930587 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b375ee7b-8fc5-4cbe-bc77-1fdc0251d88c None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:03.931015 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b375ee7b-8fc5-4cbe-bc77-1fdc0251d88c None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:03.931245 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b375ee7b-8fc5-4cbe-bc77-1fdc0251d88c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:03.932457 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b375ee7b-8fc5-4cbe-bc77-1fdc0251d88c None admin] RBAC: Adding query filter params (group.id=2767cb4da7664937aadecafa78377ea5, role.id=f910595b432f450eb4b382e0c99cf932, scope.project.id=d8086440d31c4402a8800ca68927d7e1) {{(pid=87209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:03.932457 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b375ee7b-8fc5-4cbe-bc77-1fdc0251d88c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:03.934099 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b375ee7b-8fc5-4cbe-bc77-1fdc0251d88c None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:03.945765 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 188/357] 10.222.0.66 () {56 vars in 1376 bytes} [Mon Jul 25 21:22:03 2022] GET /identity/v3/role_assignments?group.id=2767cb4da7664937aadecafa78377ea5&scope.project.id=d8086440d31c4402a8800ca68927d7e1&role.id=f910595b432f450eb4b382e0c99cf932 => generated 260 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:03.945765 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a7828b-aacf-42d2-92d7-1dee17b037e3 None None] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:03.945765 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a7828b-aacf-42d2-92d7-1dee17b037e3 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:03.945765 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a7828b-aacf-42d2-92d7-1dee17b037e3 None None] PATH_INFO: `/` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:03.947773 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 189/358] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:22:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:22:03.953383 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a7828b-aacf-42d2-92d7-1dee17b037e3 None None] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:03.989597 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:03.995565 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61c6613-22a6-4ebe-9bac-d528ae38b114 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:04.056553 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362848b3-22a1-4787-9942-c07fbd738923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:04.058480 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362848b3-22a1-4787-9942-c07fbd738923 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:04.058480 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362848b3-22a1-4787-9942-c07fbd738923 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:04.058480 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362848b3-22a1-4787-9942-c07fbd738923 None admin] PATH_INFO: `/v3/users/8f2ce01d1b574af19bf763919bc1d238` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:04.060103 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362848b3-22a1-4787-9942-c07fbd738923 None admin] RBAC: Authorizing `identity:get_user(user_id=8f2ce01d1b574af19bf763919bc1d238)` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:04.061611 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362848b3-22a1-4787-9942-c07fbd738923 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:04.063372 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 170/359] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Jul 25 21:22:03 2022] GET /identity/v3/users/8f2ce01d1b574af19bf763919bc1d238 => generated 293 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:04.064717 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccaab50-79b5-4a41-9bcd-b878b3ff1729 None None] REQUEST_METHOD: `POST` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:04.064996 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccaab50-79b5-4a41-9bcd-b878b3ff1729 None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:04.065465 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccaab50-79b5-4a41-9bcd-b878b3ff1729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:04.088000 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.auth.core [None req-fccaab50-79b5-4a41-9bcd-b878b3ff1729 None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:22:04.090079 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.fernet_utils [None req-fccaab50-79b5-4a41-9bcd-b878b3ff1729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:22:04.125953 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a7828b-aacf-42d2-92d7-1dee17b037e3 None None] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:04.174333 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6a4735-cd62-4374-880d-ed2aea8d1771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:04.175685 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6a4735-cd62-4374-880d-ed2aea8d1771 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:04.176136 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6a4735-cd62-4374-880d-ed2aea8d1771 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:04.176669 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6a4735-cd62-4374-880d-ed2aea8d1771 None admin] PATH_INFO: `/v3/roles` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:04.177648 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6a4735-cd62-4374-880d-ed2aea8d1771 None admin] RBAC: Adding query filter params (name=member) {{(pid=87209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:04.178144 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6a4735-cd62-4374-880d-ed2aea8d1771 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:04.179919 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6a4735-cd62-4374-880d-ed2aea8d1771 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:04.188730 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:04.194182 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 190/360] 10.222.0.66 () {56 vars in 1101 bytes} [Mon Jul 25 21:22:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:04.194466 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb66480b-9d73-41c5-baa6-71d0522b1c25 None None] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:04.194675 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb66480b-9d73-41c5-baa6-71d0522b1c25 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:04.195847 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb66480b-9d73-41c5-baa6-71d0522b1c25 None None] PATH_INFO: `/` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:04.195970 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 171/361] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:22:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:22:04.196641 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 191/362] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:22:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:22:04.201021 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccaab50-79b5-4a41-9bcd-b878b3ff1729 None None] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:04.202019 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb66480b-9d73-41c5-baa6-71d0522b1c25 None None] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:04.315108 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:04.347392 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb66480b-9d73-41c5-baa6-71d0522b1c25 None None] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:04.355991 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccaab50-79b5-4a41-9bcd-b878b3ff1729 None None] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:04.412688 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72af2968-9680-4390-bb14-92b69308d4a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:04.413349 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72af2968-9680-4390-bb14-92b69308d4a5 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:04.413629 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72af2968-9680-4390-bb14-92b69308d4a5 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:04.413904 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72af2968-9680-4390-bb14-92b69308d4a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:04.414502 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9917dc24-890f-4813-9b28-87e1f6276cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:04.414697 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72af2968-9680-4390-bb14-92b69308d4a5 None admin] RBAC: Adding query filter params (role.id=ca991b54c98340d797cf644d4217dca9, user.id=8f2ce01d1b574af19bf763919bc1d238, scope.system=all) {{(pid=87210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:04.415339 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72af2968-9680-4390-bb14-92b69308d4a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:04.416054 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9917dc24-890f-4813-9b28-87e1f6276cc3 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:04.416560 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9917dc24-890f-4813-9b28-87e1f6276cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:04.416783 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72af2968-9680-4390-bb14-92b69308d4a5 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:04.417233 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9917dc24-890f-4813-9b28-87e1f6276cc3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:04.441295 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 172/363] 10.222.0.66 () {56 vars in 1308 bytes} [Mon Jul 25 21:22:04 2022] GET /identity/v3/role_assignments?user.id=8f2ce01d1b574af19bf763919bc1d238&scope.system=all&role.id=ca991b54c98340d797cf644d4217dca9 => generated 510 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:04.442836 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da947b9-16ae-4479-98b9-74a2af39c343 None None] REQUEST_METHOD: `POST` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:04.443120 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da947b9-16ae-4479-98b9-74a2af39c343 None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:04.443403 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da947b9-16ae-4479-98b9-74a2af39c343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:04.476752 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.auth.core [None req-7da947b9-16ae-4479-98b9-74a2af39c343 None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:22:04.482310 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.fernet_utils [None req-7da947b9-16ae-4479-98b9-74a2af39c343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:22:04.532237 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9917dc24-890f-4813-9b28-87e1f6276cc3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:04.534105 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9917dc24-890f-4813-9b28-87e1f6276cc3 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:04.547236 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:04.570062 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 173/364] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:22:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:22:04.571390 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da947b9-16ae-4479-98b9-74a2af39c343 None None] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:04.661201 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:04.698040 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 192/365] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Jul 25 21:22:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 21:22:04.699718 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9917dc24-890f-4813-9b28-87e1f6276cc3 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:04.709376 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da947b9-16ae-4479-98b9-74a2af39c343 None None] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:04.747282 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97015cd3-7966-4283-a951-6f16df145e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:04.748335 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97015cd3-7966-4283-a951-6f16df145e63 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:04.748827 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97015cd3-7966-4283-a951-6f16df145e63 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:04.749339 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97015cd3-7966-4283-a951-6f16df145e63 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:04.761580 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97015cd3-7966-4283-a951-6f16df145e63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:22:04.767159 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application [None req-97015cd3-7966-4283-a951-6f16df145e63 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 21:22:04.767159 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:22:04.767159 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:22:04.767159 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:22:04.767159 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:22:04.767159 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:22:04.767159 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:22:04.767159 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:22:04.767159 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:22:04.767159 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:22:04.767159 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:22:04.767159 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:22:04.767159 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:22:04.767159 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:22:04.767159 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:22:04.767159 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:22:04.768301 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:22:04.768301 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:22:04.768301 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:22:04.768301 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:22:04.768301 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:22:04.768301 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:22:04.768301 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:22:04.768301 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:22:04.768301 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:22:04.768301 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:22:04.768301 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:22:04.768301 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application with Lock( Jul 25 21:22:04.768301 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:22:04.768301 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:22:04.768301 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:22:04.768301 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:22:04.769135 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:22:04.769135 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:22:04.769135 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:22:04.769135 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:22:04.769135 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:22:04.769135 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:22:04.769135 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:22:04.769135 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:22:04.769135 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:22:04.769135 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:22:04.769135 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 21:22:04.769135 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Jul 25 21:22:04.771888 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 174/366] 10.222.0.66 () {56 vars in 1114 bytes} [Mon Jul 25 21:22:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:22:04.772996 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97015cd3-7966-4283-a951-6f16df145e63 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:04.830107 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:04.912461 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9917dc24-890f-4813-9b28-87e1f6276cc3 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:04.949762 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97015cd3-7966-4283-a951-6f16df145e63 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:04.996717 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcaa44b-a7fc-451c-822d-5a10d9330752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:04.997419 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcaa44b-a7fc-451c-822d-5a10d9330752 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:04.997699 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcaa44b-a7fc-451c-822d-5a10d9330752 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:04.997879 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2d1e4b-4f3d-4b88-b5a7-d5df55274c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:04.997987 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcaa44b-a7fc-451c-822d-5a10d9330752 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:04.998831 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2d1e4b-4f3d-4b88-b5a7-d5df55274c04 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:04.999296 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2d1e4b-4f3d-4b88-b5a7-d5df55274c04 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:04.999751 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2d1e4b-4f3d-4b88-b5a7-d5df55274c04 None admin] PATH_INFO: `/v3/projects/75f1c39fe6504f958e7eea5381109120` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:05.001198 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2d1e4b-4f3d-4b88-b5a7-d5df55274c04 None admin] RBAC: Authorizing `identity:get_project(project_id=75f1c39fe6504f958e7eea5381109120)` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:05.003343 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2d1e4b-4f3d-4b88-b5a7-d5df55274c04 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:05.005637 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 175/367] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Jul 25 21:22:04 2022] GET /identity/v3/projects/75f1c39fe6504f958e7eea5381109120 => generated 302 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:05.006616 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2d1e4b-4f3d-4b88-b5a7-d5df55274c04 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:05.037725 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcaa44b-a7fc-451c-822d-5a10d9330752 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:22:05.044576 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application [None req-0bcaa44b-a7fc-451c-822d-5a10d9330752 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 21:22:05.044576 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:22:05.044576 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:22:05.044576 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:22:05.044576 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:22:05.044576 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:22:05.044576 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:22:05.044576 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:22:05.044576 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:22:05.044576 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:22:05.044576 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:22:05.044576 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:22:05.044576 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:22:05.044576 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:22:05.044576 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:22:05.044576 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:22:05.045540 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:22:05.045540 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:22:05.045540 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:22:05.045540 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:22:05.045540 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:22:05.045540 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:22:05.045540 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:22:05.045540 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:22:05.045540 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:22:05.045540 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:22:05.045540 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:22:05.045540 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application with Lock( Jul 25 21:22:05.045540 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:22:05.045540 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:22:05.045540 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:22:05.045540 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:22:05.046324 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:22:05.046324 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:22:05.046324 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:22:05.046324 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:22:05.046324 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:22:05.046324 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:22:05.046324 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:22:05.046324 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:22:05.046324 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:22:05.046324 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:22:05.046324 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 21:22:05.046324 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Jul 25 21:22:05.052190 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 193/368] 10.222.0.66 () {56 vars in 1096 bytes} [Mon Jul 25 21:22:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 353 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:22:05.055133 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcaa44b-a7fc-451c-822d-5a10d9330752 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:05.117796 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:05.171577 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2d1e4b-4f3d-4b88-b5a7-d5df55274c04 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:05.186961 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcaa44b-a7fc-451c-822d-5a10d9330752 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:05.191825 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:05.226292 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bac486-0846-49ed-9046-d69bbb8d8c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:05.228061 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bac486-0846-49ed-9046-d69bbb8d8c1d None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:05.228788 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bac486-0846-49ed-9046-d69bbb8d8c1d None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:05.229444 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bac486-0846-49ed-9046-d69bbb8d8c1d None admin] PATH_INFO: `/v3/roles` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:05.230983 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bac486-0846-49ed-9046-d69bbb8d8c1d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:05.232011 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bac486-0846-49ed-9046-d69bbb8d8c1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:05.235276 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bac486-0846-49ed-9046-d69bbb8d8c1d None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:05.245785 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d07cafa-51fa-4b94-a4ba-5b8abf458fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:05.250122 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d07cafa-51fa-4b94-a4ba-5b8abf458fd7 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:05.250677 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d07cafa-51fa-4b94-a4ba-5b8abf458fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:05.251228 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d07cafa-51fa-4b94-a4ba-5b8abf458fd7 None admin] PATH_INFO: `/v3/groups/2767cb4da7664937aadecafa78377ea5` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:05.252425 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 176/369] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Jul 25 21:22:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:05.253930 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d07cafa-51fa-4b94-a4ba-5b8abf458fd7 None admin] RBAC: Authorizing `identity:get_group(group_id=2767cb4da7664937aadecafa78377ea5)` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:05.255351 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bac486-0846-49ed-9046-d69bbb8d8c1d None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:05.257998 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d07cafa-51fa-4b94-a4ba-5b8abf458fd7 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:05.261192 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 194/370] 10.222.0.66 () {56 vars in 1180 bytes} [Mon Jul 25 21:22:05 2022] GET /identity/v3/groups/2767cb4da7664937aadecafa78377ea5 => generated 226 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:05.262692 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d07cafa-51fa-4b94-a4ba-5b8abf458fd7 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:05.417310 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bac486-0846-49ed-9046-d69bbb8d8c1d None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:05.417837 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d07cafa-51fa-4b94-a4ba-5b8abf458fd7 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:05.436391 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:05.467470 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e0c543-27a8-4eed-b1bb-88013690c12a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:05.468119 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e0c543-27a8-4eed-b1bb-88013690c12a None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:05.468403 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e0c543-27a8-4eed-b1bb-88013690c12a None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:05.468674 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e0c543-27a8-4eed-b1bb-88013690c12a None admin] PATH_INFO: `/v3/roles` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:05.469433 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e0c543-27a8-4eed-b1bb-88013690c12a None admin] RBAC: Adding query filter params (name=admin) {{(pid=87210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:05.469741 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e0c543-27a8-4eed-b1bb-88013690c12a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:05.471677 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e0c543-27a8-4eed-b1bb-88013690c12a None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:05.472455 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36267923-1c90-4c6a-9237-6f319acee56d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:05.473302 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36267923-1c90-4c6a-9237-6f319acee56d None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:05.473721 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36267923-1c90-4c6a-9237-6f319acee56d None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:05.474149 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36267923-1c90-4c6a-9237-6f319acee56d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:05.483984 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 177/371] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Jul 25 21:22:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:05.484273 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e0c543-27a8-4eed-b1bb-88013690c12a None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:05.538986 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:05.562210 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36267923-1c90-4c6a-9237-6f319acee56d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:05.563694 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36267923-1c90-4c6a-9237-6f319acee56d None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:05.620755 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e0c543-27a8-4eed-b1bb-88013690c12a None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:05.663563 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f9eaed-dc7c-469a-ab95-39ed188b0fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:05.664196 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f9eaed-dc7c-469a-ab95-39ed188b0fb5 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:05.664474 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f9eaed-dc7c-469a-ab95-39ed188b0fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:05.664746 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f9eaed-dc7c-469a-ab95-39ed188b0fb5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:05.666009 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f9eaed-dc7c-469a-ab95-39ed188b0fb5 None admin] RBAC: Adding query filter params (group.id=2767cb4da7664937aadecafa78377ea5, role.id=faec70ea0ba040efa587f542f054e49e, scope.project.id=75f1c39fe6504f958e7eea5381109120) {{(pid=87210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:05.666323 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f9eaed-dc7c-469a-ab95-39ed188b0fb5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:05.667802 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f9eaed-dc7c-469a-ab95-39ed188b0fb5 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:05.675466 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 178/372] 10.222.0.66 () {56 vars in 1376 bytes} [Mon Jul 25 21:22:05 2022] GET /identity/v3/role_assignments?group.id=2767cb4da7664937aadecafa78377ea5&scope.project.id=75f1c39fe6504f958e7eea5381109120&role.id=faec70ea0ba040efa587f542f054e49e => generated 260 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:05.676388 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f9eaed-dc7c-469a-ab95-39ed188b0fb5 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:05.699542 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 195/373] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Jul 25 21:22:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 21:22:05.706813 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36267923-1c90-4c6a-9237-6f319acee56d None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:05.725769 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:05.868700 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36267923-1c90-4c6a-9237-6f319acee56d None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:05.891890 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f9eaed-dc7c-469a-ab95-39ed188b0fb5 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:05.894424 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:05.916648 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67729361-955c-45a2-8190-b22bc94e6ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:05.917887 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67729361-955c-45a2-8190-b22bc94e6ec3 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:05.918660 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67729361-955c-45a2-8190-b22bc94e6ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:05.919120 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67729361-955c-45a2-8190-b22bc94e6ec3 None admin] PATH_INFO: `/v3/projects/75f1c39fe6504f958e7eea5381109120` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:05.920767 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67729361-955c-45a2-8190-b22bc94e6ec3 None admin] RBAC: Authorizing `identity:get_project(project_id=75f1c39fe6504f958e7eea5381109120)` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:05.922562 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67729361-955c-45a2-8190-b22bc94e6ec3 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:05.925441 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 196/374] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Jul 25 21:22:05 2022] GET /identity/v3/projects/75f1c39fe6504f958e7eea5381109120 => generated 302 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:05.930830 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67729361-955c-45a2-8190-b22bc94e6ec3 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:05.979723 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24de2b2e-7ec7-4980-8992-dd5237330939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:05.980294 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24de2b2e-7ec7-4980-8992-dd5237330939 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:05.980574 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24de2b2e-7ec7-4980-8992-dd5237330939 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:05.980849 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24de2b2e-7ec7-4980-8992-dd5237330939 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:06.087179 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:06.105520 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24de2b2e-7ec7-4980-8992-dd5237330939 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:06.107013 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24de2b2e-7ec7-4980-8992-dd5237330939 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:06.126245 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67729361-955c-45a2-8190-b22bc94e6ec3 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:06.196432 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb81b9f3-6d33-476b-8b0d-a41bc877129d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:06.197221 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb81b9f3-6d33-476b-8b0d-a41bc877129d None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:06.197519 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb81b9f3-6d33-476b-8b0d-a41bc877129d None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:06.197796 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb81b9f3-6d33-476b-8b0d-a41bc877129d None admin] PATH_INFO: `/v3/groups/2767cb4da7664937aadecafa78377ea5` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:06.200214 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb81b9f3-6d33-476b-8b0d-a41bc877129d None admin] RBAC: Authorizing `identity:get_group(group_id=2767cb4da7664937aadecafa78377ea5)` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:06.201724 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb81b9f3-6d33-476b-8b0d-a41bc877129d None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:06.204549 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 197/375] 10.222.0.66 () {56 vars in 1180 bytes} [Mon Jul 25 21:22:05 2022] GET /identity/v3/groups/2767cb4da7664937aadecafa78377ea5 => generated 226 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:06.214529 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb81b9f3-6d33-476b-8b0d-a41bc877129d None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:06.312410 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 179/376] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Jul 25 21:22:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 636 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 21:22:06.324801 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24de2b2e-7ec7-4980-8992-dd5237330939 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:06.326995 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:06.428979 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb81b9f3-6d33-476b-8b0d-a41bc877129d None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:06.473739 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4771719-8ac0-42f2-984e-77d5955a1226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:06.474387 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4771719-8ac0-42f2-984e-77d5955a1226 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:06.474669 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4771719-8ac0-42f2-984e-77d5955a1226 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:06.474946 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4771719-8ac0-42f2-984e-77d5955a1226 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:06.476052 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4771719-8ac0-42f2-984e-77d5955a1226 None admin] RBAC: Adding query filter params (group.id=2767cb4da7664937aadecafa78377ea5, role.id=f910595b432f450eb4b382e0c99cf932, scope.project.id=75f1c39fe6504f958e7eea5381109120) {{(pid=87209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:06.476364 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4771719-8ac0-42f2-984e-77d5955a1226 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:06.478085 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4771719-8ac0-42f2-984e-77d5955a1226 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:06.486511 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 198/377] 10.222.0.66 () {56 vars in 1376 bytes} [Mon Jul 25 21:22:06 2022] GET /identity/v3/role_assignments?group.id=2767cb4da7664937aadecafa78377ea5&scope.project.id=75f1c39fe6504f958e7eea5381109120&role.id=f910595b432f450eb4b382e0c99cf932 => generated 260 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:06.488106 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d31f20-9d1b-4b3a-837a-7eeb00b45778 None None] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:06.488394 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d31f20-9d1b-4b3a-837a-7eeb00b45778 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:06.493370 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d31f20-9d1b-4b3a-837a-7eeb00b45778 None None] PATH_INFO: `/` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:06.495161 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 199/378] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:22:06 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:22:06.502315 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c238517-3105-4105-b485-9febef4664ae None None] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:06.502796 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c238517-3105-4105-b485-9febef4664ae None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:06.503160 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c238517-3105-4105-b485-9febef4664ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:06.504301 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24de2b2e-7ec7-4980-8992-dd5237330939 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:06.534727 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.auth.core [None req-4c238517-3105-4105-b485-9febef4664ae None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:22:06.535974 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-4c238517-3105-4105-b485-9febef4664ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:22:06.545439 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:06.550788 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3974d769-c835-4951-a1ea-8a9259395c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:06.551736 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3974d769-c835-4951-a1ea-8a9259395c2f None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:06.552638 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3974d769-c835-4951-a1ea-8a9259395c2f None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:06.553128 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3974d769-c835-4951-a1ea-8a9259395c2f None admin] PATH_INFO: `/v3/projects/fa9501d798e8481da3be76351eec2bf6` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:06.554723 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3974d769-c835-4951-a1ea-8a9259395c2f None admin] RBAC: Authorizing `identity:get_project(project_id=fa9501d798e8481da3be76351eec2bf6)` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:06.556388 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3974d769-c835-4951-a1ea-8a9259395c2f None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:06.558933 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 180/379] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Jul 25 21:22:06 2022] GET /identity/v3/projects/fa9501d798e8481da3be76351eec2bf6 => generated 344 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:06.579314 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3974d769-c835-4951-a1ea-8a9259395c2f None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:06.637111 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 200/380] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:22:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 21:22:06.656175 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c238517-3105-4105-b485-9febef4664ae None None] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:06.684060 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:06.732065 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3974d769-c835-4951-a1ea-8a9259395c2f None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:06.762688 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c238517-3105-4105-b485-9febef4664ae None None] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:06.782123 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ead61b-9a77-4060-a134-457f7b2e2190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:06.782850 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ead61b-9a77-4060-a134-457f7b2e2190 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:06.783138 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ead61b-9a77-4060-a134-457f7b2e2190 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:06.783408 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ead61b-9a77-4060-a134-457f7b2e2190 None admin] PATH_INFO: `/v3/groups/23070abab6f649c9a657de3e19fa7f27` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:06.790707 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ead61b-9a77-4060-a134-457f7b2e2190 None admin] RBAC: Authorizing `identity:get_group(group_id=23070abab6f649c9a657de3e19fa7f27)` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:06.792207 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ead61b-9a77-4060-a134-457f7b2e2190 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:06.794337 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 181/381] 10.222.0.66 () {56 vars in 1180 bytes} [Mon Jul 25 21:22:06 2022] GET /identity/v3/groups/23070abab6f649c9a657de3e19fa7f27 => generated 229 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:06.795597 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ed204c-464e-4a88-bbee-50928f20cbca None None] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:06.795882 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ed204c-464e-4a88-bbee-50928f20cbca None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:06.796152 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ed204c-464e-4a88-bbee-50928f20cbca None None] PATH_INFO: `/` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:06.802326 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 182/382] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:22:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:22:06.804549 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f929d287-b71c-4692-ae78-eecb094d61a5 None None] REQUEST_METHOD: `POST` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:06.804834 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f929d287-b71c-4692-ae78-eecb094d61a5 None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:06.805252 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f929d287-b71c-4692-ae78-eecb094d61a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:06.813618 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05053b9-3ef9-4735-b745-236ca9a4649b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:06.814524 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05053b9-3ef9-4735-b745-236ca9a4649b None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:06.814813 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05053b9-3ef9-4735-b745-236ca9a4649b None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:06.815087 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05053b9-3ef9-4735-b745-236ca9a4649b None admin] PATH_INFO: `/v3/roles/member` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:06.826302 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.auth.core [None req-f929d287-b71c-4692-ae78-eecb094d61a5 None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:22:06.827658 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.fernet_utils [None req-f929d287-b71c-4692-ae78-eecb094d61a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:22:06.830468 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05053b9-3ef9-4735-b745-236ca9a4649b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:22:06.836601 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application [None req-c05053b9-3ef9-4735-b745-236ca9a4649b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 21:22:06.836601 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:22:06.836601 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:22:06.836601 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:22:06.836601 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:22:06.836601 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:22:06.836601 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:22:06.836601 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:22:06.836601 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:22:06.836601 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:22:06.836601 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:22:06.836601 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:22:06.836601 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:22:06.836601 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:22:06.836601 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:22:06.836601 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:22:06.837859 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:22:06.837859 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:22:06.837859 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:22:06.837859 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:22:06.837859 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:22:06.837859 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:22:06.837859 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:22:06.837859 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:22:06.837859 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:22:06.837859 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:22:06.837859 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:22:06.837859 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application with Lock( Jul 25 21:22:06.837859 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:22:06.837859 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:22:06.837859 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:22:06.837859 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:22:06.839243 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:22:06.839243 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:22:06.839243 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:22:06.839243 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:22:06.839243 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:22:06.839243 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:22:06.839243 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:22:06.839243 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:22:06.839243 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:22:06.839243 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:22:06.839243 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 21:22:06.839243 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Jul 25 21:22:06.839243 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 201/383] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Jul 25 21:22:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:22:06.839243 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05053b9-3ef9-4735-b745-236ca9a4649b None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:06.847205 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:06.922813 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 183/384] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:22:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 21:22:06.924480 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f929d287-b71c-4692-ae78-eecb094d61a5 None None] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:06.970634 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05053b9-3ef9-4735-b745-236ca9a4649b None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:07.007671 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a39946c-7833-46ea-a345-288f99b7b42a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:07.008548 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a39946c-7833-46ea-a345-288f99b7b42a None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:07.008992 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a39946c-7833-46ea-a345-288f99b7b42a None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:07.009465 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a39946c-7833-46ea-a345-288f99b7b42a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:07.010405 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a39946c-7833-46ea-a345-288f99b7b42a None admin] RBAC: Adding query filter params (group.id=23070abab6f649c9a657de3e19fa7f27, role.id=216a86497a3a4593ba08730ea8697df3, scope.project.id=fa9501d798e8481da3be76351eec2bf6) {{(pid=87209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:07.010852 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a39946c-7833-46ea-a345-288f99b7b42a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:07.012456 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a39946c-7833-46ea-a345-288f99b7b42a None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:07.018518 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 202/385] 10.222.0.66 () {56 vars in 1376 bytes} [Mon Jul 25 21:22:06 2022] GET /identity/v3/role_assignments?group.id=23070abab6f649c9a657de3e19fa7f27&scope.project.id=fa9501d798e8481da3be76351eec2bf6&role.id=216a86497a3a4593ba08730ea8697df3 => generated 260 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:07.019147 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:07.019650 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a39946c-7833-46ea-a345-288f99b7b42a None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:07.063254 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f929d287-b71c-4692-ae78-eecb094d61a5 None None] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:07.097707 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:07.106029 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a744d8-74d8-4690-9dda-d3b09ea25e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:07.106566 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a744d8-74d8-4690-9dda-d3b09ea25e1b None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:07.107808 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a744d8-74d8-4690-9dda-d3b09ea25e1b None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:07.107808 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a744d8-74d8-4690-9dda-d3b09ea25e1b None admin] PATH_INFO: `/v3/roles` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:07.108781 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a744d8-74d8-4690-9dda-d3b09ea25e1b None admin] RBAC: Adding query filter params (name=member) {{(pid=87210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:07.109155 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a744d8-74d8-4690-9dda-d3b09ea25e1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:07.110598 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a744d8-74d8-4690-9dda-d3b09ea25e1b None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:07.120882 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 184/386] 10.222.0.66 () {56 vars in 1101 bytes} [Mon Jul 25 21:22:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:07.127231 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a744d8-74d8-4690-9dda-d3b09ea25e1b None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:07.141825 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a39946c-7833-46ea-a345-288f99b7b42a None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:07.182227 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd764c4-2afa-4d2e-a28e-28313b3db88d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:07.183193 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd764c4-2afa-4d2e-a28e-28313b3db88d None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:07.183628 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd764c4-2afa-4d2e-a28e-28313b3db88d None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:07.184041 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd764c4-2afa-4d2e-a28e-28313b3db88d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:07.198614 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd764c4-2afa-4d2e-a28e-28313b3db88d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:22:07.204408 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application [None req-3cd764c4-2afa-4d2e-a28e-28313b3db88d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 21:22:07.204408 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:22:07.204408 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:22:07.204408 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:22:07.204408 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:22:07.204408 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:22:07.204408 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:22:07.204408 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:22:07.204408 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:22:07.204408 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:22:07.204408 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:22:07.204408 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:22:07.204408 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:22:07.204408 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:22:07.204408 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:22:07.204408 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:22:07.205641 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:22:07.205641 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:22:07.205641 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:22:07.205641 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:22:07.205641 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:22:07.205641 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:22:07.205641 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:22:07.205641 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:22:07.205641 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:22:07.205641 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:22:07.205641 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:22:07.205641 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application with Lock( Jul 25 21:22:07.205641 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:22:07.205641 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:22:07.205641 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:22:07.205641 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:22:07.206614 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:22:07.206614 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:22:07.206614 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:22:07.206614 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:22:07.206614 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:22:07.206614 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:22:07.206614 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:22:07.206614 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:22:07.206614 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:22:07.206614 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:22:07.206614 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 21:22:07.206614 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Jul 25 21:22:07.208625 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 203/387] 10.222.0.66 () {56 vars in 1114 bytes} [Mon Jul 25 21:22:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:22:07.233629 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd764c4-2afa-4d2e-a28e-28313b3db88d None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:07.254233 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a744d8-74d8-4690-9dda-d3b09ea25e1b None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:07.289109 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:07.295094 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134ca257-e62b-4914-84b6-5febe1ac2e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:07.297770 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134ca257-e62b-4914-84b6-5febe1ac2e19 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:07.298155 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134ca257-e62b-4914-84b6-5febe1ac2e19 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:07.298504 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134ca257-e62b-4914-84b6-5febe1ac2e19 None admin] PATH_INFO: `/v3/groups/2767cb4da7664937aadecafa78377ea5` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:07.301792 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134ca257-e62b-4914-84b6-5febe1ac2e19 None admin] RBAC: Authorizing `identity:get_group(group_id=2767cb4da7664937aadecafa78377ea5)` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:07.303586 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134ca257-e62b-4914-84b6-5febe1ac2e19 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:07.307691 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 185/388] 10.222.0.66 () {56 vars in 1180 bytes} [Mon Jul 25 21:22:07 2022] GET /identity/v3/groups/2767cb4da7664937aadecafa78377ea5 => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:22:07.314684 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134ca257-e62b-4914-84b6-5febe1ac2e19 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:07.406405 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd764c4-2afa-4d2e-a28e-28313b3db88d None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:07.435768 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134ca257-e62b-4914-84b6-5febe1ac2e19 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:07.446118 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:07.459910 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c23e140-a292-4144-a860-881df29ae0ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:07.460680 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c23e140-a292-4144-a860-881df29ae0ba None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:07.461065 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c23e140-a292-4144-a860-881df29ae0ba None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:07.461446 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c23e140-a292-4144-a860-881df29ae0ba None admin] PATH_INFO: `/v3/roles` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:07.462279 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c23e140-a292-4144-a860-881df29ae0ba None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:07.462680 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c23e140-a292-4144-a860-881df29ae0ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:07.464169 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c23e140-a292-4144-a860-881df29ae0ba None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:07.475840 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70382342-f108-45a8-a10d-092cb03c44d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:07.476745 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70382342-f108-45a8-a10d-092cb03c44d1 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:07.477259 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70382342-f108-45a8-a10d-092cb03c44d1 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:07.477674 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70382342-f108-45a8-a10d-092cb03c44d1 None admin] PATH_INFO: `/v3/projects/d8086440d31c4402a8800ca68927d7e1` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:07.482113 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 204/389] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Jul 25 21:22:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:07.483120 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70382342-f108-45a8-a10d-092cb03c44d1 None admin] RBAC: Authorizing `identity:get_project(project_id=d8086440d31c4402a8800ca68927d7e1)` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:07.484587 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70382342-f108-45a8-a10d-092cb03c44d1 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:07.487582 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c23e140-a292-4144-a860-881df29ae0ba None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:07.488560 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 186/390] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Jul 25 21:22:07 2022] GET /identity/v3/projects/d8086440d31c4402a8800ca68927d7e1 => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:07.494443 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70382342-f108-45a8-a10d-092cb03c44d1 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:07.610294 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c23e140-a292-4144-a860-881df29ae0ba None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:07.645482 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:07.650520 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aacdafb-bd4c-44ce-9d41-52f3fe5a5a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:07.651514 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aacdafb-bd4c-44ce-9d41-52f3fe5a5a20 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:07.652662 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aacdafb-bd4c-44ce-9d41-52f3fe5a5a20 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:07.652662 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aacdafb-bd4c-44ce-9d41-52f3fe5a5a20 None admin] PATH_INFO: `/v3/groups/2767cb4da7664937aadecafa78377ea5` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:07.653625 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aacdafb-bd4c-44ce-9d41-52f3fe5a5a20 None admin] RBAC: Authorizing `identity:get_group(group_id=2767cb4da7664937aadecafa78377ea5)` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:07.655355 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aacdafb-bd4c-44ce-9d41-52f3fe5a5a20 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:07.661271 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 205/391] 10.222.0.66 () {56 vars in 1180 bytes} [Mon Jul 25 21:22:07 2022] GET /identity/v3/groups/2767cb4da7664937aadecafa78377ea5 => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:07.664437 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aacdafb-bd4c-44ce-9d41-52f3fe5a5a20 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:07.729408 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:07.755176 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70382342-f108-45a8-a10d-092cb03c44d1 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:07.781424 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aacdafb-bd4c-44ce-9d41-52f3fe5a5a20 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:07.822073 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4053539f-783e-4562-8c05-e21efd5f1ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:07.822740 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4053539f-783e-4562-8c05-e21efd5f1ef8 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:07.823022 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4053539f-783e-4562-8c05-e21efd5f1ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:07.823299 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4053539f-783e-4562-8c05-e21efd5f1ef8 None admin] PATH_INFO: `/v3/projects/d8086440d31c4402a8800ca68927d7e1` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:07.824931 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4053539f-783e-4562-8c05-e21efd5f1ef8 None admin] RBAC: Authorizing `identity:get_project(project_id=d8086440d31c4402a8800ca68927d7e1)` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:07.826570 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4053539f-783e-4562-8c05-e21efd5f1ef8 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:07.833285 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 206/392] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Jul 25 21:22:07 2022] GET /identity/v3/projects/d8086440d31c4402a8800ca68927d7e1 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:22:07.834190 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3016c8b9-e921-4ffe-8e2e-81cdcbe91b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:07.835153 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3016c8b9-e921-4ffe-8e2e-81cdcbe91b54 None admin] REQUEST_METHOD: `PUT` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:07.835321 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4053539f-783e-4562-8c05-e21efd5f1ef8 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:07.835800 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3016c8b9-e921-4ffe-8e2e-81cdcbe91b54 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:07.836257 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3016c8b9-e921-4ffe-8e2e-81cdcbe91b54 None admin] PATH_INFO: `/v3/projects/d8086440d31c4402a8800ca68927d7e1/groups/2767cb4da7664937aadecafa78377ea5/roles/faec70ea0ba040efa587f542f054e49e` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:07.842378 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3016c8b9-e921-4ffe-8e2e-81cdcbe91b54 None admin] RBAC: Authorizing `identity:create_grant(project_id=d8086440d31c4402a8800ca68927d7e1, group_id=2767cb4da7664937aadecafa78377ea5, role_id=faec70ea0ba040efa587f542f054e49e)` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:07.844053 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3016c8b9-e921-4ffe-8e2e-81cdcbe91b54 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:07.871182 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 187/393] 10.222.0.66 () {58 vars in 1442 bytes} [Mon Jul 25 21:22:07 2022] PUT /identity/v3/projects/d8086440d31c4402a8800ca68927d7e1/groups/2767cb4da7664937aadecafa78377ea5/roles/faec70ea0ba040efa587f542f054e49e => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 21:22:07.950712 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4053539f-783e-4562-8c05-e21efd5f1ef8 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:07.977351 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:07.991038 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088f8cb9-e598-492f-b95b-2a2436afe384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:07.991767 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088f8cb9-e598-492f-b95b-2a2436afe384 None admin] REQUEST_METHOD: `PUT` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:07.992055 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088f8cb9-e598-492f-b95b-2a2436afe384 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:07.992333 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088f8cb9-e598-492f-b95b-2a2436afe384 None admin] PATH_INFO: `/v3/projects/d8086440d31c4402a8800ca68927d7e1/groups/2767cb4da7664937aadecafa78377ea5/roles/f910595b432f450eb4b382e0c99cf932` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:07.994703 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088f8cb9-e598-492f-b95b-2a2436afe384 None admin] RBAC: Authorizing `identity:create_grant(project_id=d8086440d31c4402a8800ca68927d7e1, group_id=2767cb4da7664937aadecafa78377ea5, role_id=f910595b432f450eb4b382e0c99cf932)` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:07.996375 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088f8cb9-e598-492f-b95b-2a2436afe384 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:08.018670 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 207/394] 10.222.0.66 () {58 vars in 1442 bytes} [Mon Jul 25 21:22:07 2022] PUT /identity/v3/projects/d8086440d31c4402a8800ca68927d7e1/groups/2767cb4da7664937aadecafa78377ea5/roles/f910595b432f450eb4b382e0c99cf932 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 21:22:08.444875 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12788312-2269-41b5-8a53-3e430a26fda4 None None] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:08.445639 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12788312-2269-41b5-8a53-3e430a26fda4 None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:08.446119 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12788312-2269-41b5-8a53-3e430a26fda4 None None] PATH_INFO: `/` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:08.447913 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 188/395] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:22:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:22:08.454794 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63c349c-7422-4f65-b6b8-fd57914cc057 None None] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:08.455361 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63c349c-7422-4f65-b6b8-fd57914cc057 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:08.455835 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63c349c-7422-4f65-b6b8-fd57914cc057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:08.474673 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.auth.core [None req-f63c349c-7422-4f65-b6b8-fd57914cc057 None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:22:08.476178 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-f63c349c-7422-4f65-b6b8-fd57914cc057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:22:08.556812 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 208/396] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:22:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:22:08.601591 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12788312-2269-41b5-8a53-3e430a26fda4 None None] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:08.732938 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12788312-2269-41b5-8a53-3e430a26fda4 None None] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:08.763047 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:08.775596 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbd6891-bc07-4dd5-9e78-afce9ddbbf83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:08.776679 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbd6891-bc07-4dd5-9e78-afce9ddbbf83 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:08.777395 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbd6891-bc07-4dd5-9e78-afce9ddbbf83 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:08.777914 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbd6891-bc07-4dd5-9e78-afce9ddbbf83 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:08.790331 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbd6891-bc07-4dd5-9e78-afce9ddbbf83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:22:08.795738 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application [None req-fbbd6891-bc07-4dd5-9e78-afce9ddbbf83 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 21:22:08.795738 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:22:08.795738 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:22:08.795738 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:22:08.795738 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:22:08.795738 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:22:08.795738 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:22:08.795738 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:22:08.795738 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:22:08.795738 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:22:08.795738 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:22:08.795738 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:22:08.795738 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:22:08.795738 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:22:08.795738 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:22:08.795738 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:22:08.796612 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:22:08.796612 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:22:08.796612 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:22:08.796612 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:22:08.796612 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:22:08.796612 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:22:08.796612 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:22:08.796612 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:22:08.796612 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:22:08.796612 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:22:08.796612 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:22:08.796612 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application with Lock( Jul 25 21:22:08.796612 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:22:08.796612 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:22:08.796612 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:22:08.796612 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:22:08.797455 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:22:08.797455 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:22:08.797455 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:22:08.797455 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:22:08.797455 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:22:08.797455 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:22:08.797455 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:22:08.797455 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:22:08.797455 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:22:08.797455 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:22:08.797455 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 21:22:08.797455 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Jul 25 21:22:08.798758 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 189/397] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Jul 25 21:22:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:22:08.803509 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63c349c-7422-4f65-b6b8-fd57914cc057 None None] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:08.917951 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63c349c-7422-4f65-b6b8-fd57914cc057 None None] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:08.939261 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:08.965176 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69e7328-b6d3-4617-8640-c189abf7b842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:08.965404 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e7328-b6d3-4617-8640-c189abf7b842 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:08.965609 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e7328-b6d3-4617-8640-c189abf7b842 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:08.969137 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e7328-b6d3-4617-8640-c189abf7b842 None admin] PATH_INFO: `/v3/roles` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:08.969137 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69e7328-b6d3-4617-8640-c189abf7b842 None admin] RBAC: Adding query filter params (name=member) {{(pid=87209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:08.969137 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69e7328-b6d3-4617-8640-c189abf7b842 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:08.969137 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69e7328-b6d3-4617-8640-c189abf7b842 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:08.978162 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 209/398] 10.222.0.66 () {56 vars in 1101 bytes} [Mon Jul 25 21:22:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:08.984029 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbd6891-bc07-4dd5-9e78-afce9ddbbf83 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:09.128982 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbd6891-bc07-4dd5-9e78-afce9ddbbf83 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:09.176804 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20353380-78b1-4b50-8035-25e5139051ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:09.177496 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20353380-78b1-4b50-8035-25e5139051ed None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:09.177774 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20353380-78b1-4b50-8035-25e5139051ed None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:09.178045 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20353380-78b1-4b50-8035-25e5139051ed None admin] PATH_INFO: `/v3/groups/2767cb4da7664937aadecafa78377ea5` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:09.179199 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20353380-78b1-4b50-8035-25e5139051ed None admin] RBAC: Authorizing `identity:get_group(group_id=2767cb4da7664937aadecafa78377ea5)` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:09.180656 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20353380-78b1-4b50-8035-25e5139051ed None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:09.183595 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 190/399] 10.222.0.66 () {56 vars in 1180 bytes} [Mon Jul 25 21:22:08 2022] GET /identity/v3/groups/2767cb4da7664937aadecafa78377ea5 => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:09.188233 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69e7328-b6d3-4617-8640-c189abf7b842 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:09.325973 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69e7328-b6d3-4617-8640-c189abf7b842 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:09.378178 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db2d213-3e5c-414a-a50c-f25001c9e7cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:09.378844 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db2d213-3e5c-414a-a50c-f25001c9e7cc None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:09.379124 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db2d213-3e5c-414a-a50c-f25001c9e7cc None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:09.379406 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db2d213-3e5c-414a-a50c-f25001c9e7cc None admin] PATH_INFO: `/v3/projects/75f1c39fe6504f958e7eea5381109120` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:09.383278 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db2d213-3e5c-414a-a50c-f25001c9e7cc None admin] RBAC: Authorizing `identity:get_project(project_id=75f1c39fe6504f958e7eea5381109120)` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:09.384767 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db2d213-3e5c-414a-a50c-f25001c9e7cc None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:09.386817 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 210/400] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Jul 25 21:22:09 2022] GET /identity/v3/projects/75f1c39fe6504f958e7eea5381109120 => generated 302 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:09.392481 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20353380-78b1-4b50-8035-25e5139051ed None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:09.499763 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:09.565211 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20353380-78b1-4b50-8035-25e5139051ed None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:09.611404 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a89db1-f276-4d36-906e-ab1c5b408af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:09.612096 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a89db1-f276-4d36-906e-ab1c5b408af4 None admin] REQUEST_METHOD: `PUT` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:09.612387 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a89db1-f276-4d36-906e-ab1c5b408af4 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:09.612665 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a89db1-f276-4d36-906e-ab1c5b408af4 None admin] PATH_INFO: `/v3/projects/75f1c39fe6504f958e7eea5381109120/groups/2767cb4da7664937aadecafa78377ea5/roles/faec70ea0ba040efa587f542f054e49e` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:09.614940 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a89db1-f276-4d36-906e-ab1c5b408af4 None admin] RBAC: Authorizing `identity:create_grant(project_id=75f1c39fe6504f958e7eea5381109120, group_id=2767cb4da7664937aadecafa78377ea5, role_id=faec70ea0ba040efa587f542f054e49e)` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:09.616483 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a89db1-f276-4d36-906e-ab1c5b408af4 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:09.639232 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 191/401] 10.222.0.66 () {58 vars in 1442 bytes} [Mon Jul 25 21:22:09 2022] PUT /identity/v3/projects/75f1c39fe6504f958e7eea5381109120/groups/2767cb4da7664937aadecafa78377ea5/roles/faec70ea0ba040efa587f542f054e49e => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 21:22:09.805949 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28ec7c0-5cfc-44c9-8826-6bd12194d89a None None] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:09.806526 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28ec7c0-5cfc-44c9-8826-6bd12194d89a None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:09.806657 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28ec7c0-5cfc-44c9-8826-6bd12194d89a None None] PATH_INFO: `/` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:09.808357 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 211/402] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:22:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:22:09.817256 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d78d60-d457-40e1-9ae3-d49bdba75192 None None] REQUEST_METHOD: `POST` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:09.817809 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d78d60-d457-40e1-9ae3-d49bdba75192 None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:09.817809 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d78d60-d457-40e1-9ae3-d49bdba75192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:09.850468 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.auth.core [None req-e5d78d60-d457-40e1-9ae3-d49bdba75192 None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:22:09.851726 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.fernet_utils [None req-e5d78d60-d457-40e1-9ae3-d49bdba75192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:22:09.931591 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 192/403] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:22:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:22:09.963978 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28ec7c0-5cfc-44c9-8826-6bd12194d89a None None] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:10.024710 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:10.101774 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28ec7c0-5cfc-44c9-8826-6bd12194d89a None None] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:10.144822 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5f4bc1-b577-4c21-921f-737a8166cc86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:10.145502 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5f4bc1-b577-4c21-921f-737a8166cc86 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:10.145781 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5f4bc1-b577-4c21-921f-737a8166cc86 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:10.146052 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5f4bc1-b577-4c21-921f-737a8166cc86 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:10.160653 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5f4bc1-b577-4c21-921f-737a8166cc86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:22:10.166483 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application [None req-ac5f4bc1-b577-4c21-921f-737a8166cc86 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 21:22:10.166483 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:22:10.166483 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:22:10.166483 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:22:10.166483 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:22:10.166483 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:22:10.166483 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:22:10.166483 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:22:10.166483 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:22:10.166483 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:22:10.166483 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:22:10.166483 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:22:10.166483 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:22:10.166483 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:22:10.166483 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:22:10.166483 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:22:10.167402 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:22:10.167402 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:22:10.167402 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:22:10.167402 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:22:10.167402 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:22:10.167402 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:22:10.167402 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:22:10.167402 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:22:10.167402 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:22:10.167402 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:22:10.167402 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:22:10.167402 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application with Lock( Jul 25 21:22:10.167402 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:22:10.167402 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:22:10.167402 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:22:10.167402 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:22:10.168268 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:22:10.168268 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:22:10.168268 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:22:10.168268 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:22:10.168268 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:22:10.168268 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:22:10.168268 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:22:10.168268 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:22:10.168268 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:22:10.168268 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:22:10.168268 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 21:22:10.168268 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Jul 25 21:22:10.172283 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 212/404] 10.222.0.66 () {56 vars in 1114 bytes} [Mon Jul 25 21:22:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:22:10.173934 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d78d60-d457-40e1-9ae3-d49bdba75192 None None] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:10.237656 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:10.347610 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d78d60-d457-40e1-9ae3-d49bdba75192 None None] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:10.399175 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cfe971-aee7-4fac-9915-157dbd615670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:10.400250 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cfe971-aee7-4fac-9915-157dbd615670 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:10.400726 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cfe971-aee7-4fac-9915-157dbd615670 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:10.401219 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cfe971-aee7-4fac-9915-157dbd615670 None admin] PATH_INFO: `/v3/roles` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:10.402141 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cfe971-aee7-4fac-9915-157dbd615670 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:10.402640 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cfe971-aee7-4fac-9915-157dbd615670 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:10.404249 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cfe971-aee7-4fac-9915-157dbd615670 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:10.409427 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf33113-1e2e-4916-a254-85c95db03651 None None] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:10.409711 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf33113-1e2e-4916-a254-85c95db03651 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:10.409986 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf33113-1e2e-4916-a254-85c95db03651 None None] PATH_INFO: `/` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:10.412639 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 213/405] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:22:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:22:10.417118 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c525aa8-3da4-4f4d-b8e1-c363fe6c4d5b None None] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:10.417406 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c525aa8-3da4-4f4d-b8e1-c363fe6c4d5b None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:10.417682 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c525aa8-3da4-4f4d-b8e1-c363fe6c4d5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:10.419406 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 193/406] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Jul 25 21:22:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:10.426201 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cfe971-aee7-4fac-9915-157dbd615670 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:10.437145 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.auth.core [None req-9c525aa8-3da4-4f4d-b8e1-c363fe6c4d5b None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:22:10.438337 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-9c525aa8-3da4-4f4d-b8e1-c363fe6c4d5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:22:10.549392 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 214/407] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:22:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 21:22:10.592925 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c525aa8-3da4-4f4d-b8e1-c363fe6c4d5b None None] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:10.614936 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cfe971-aee7-4fac-9915-157dbd615670 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:10.624014 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:10.657486 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:10.667428 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee8b3b5-a084-4cea-a993-bd5c8fe8182d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:10.668106 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee8b3b5-a084-4cea-a993-bd5c8fe8182d None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:10.668393 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee8b3b5-a084-4cea-a993-bd5c8fe8182d None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:10.668639 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee8b3b5-a084-4cea-a993-bd5c8fe8182d None admin] PATH_INFO: `/v3/groups/2767cb4da7664937aadecafa78377ea5` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:10.669821 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee8b3b5-a084-4cea-a993-bd5c8fe8182d None admin] RBAC: Authorizing `identity:get_group(group_id=2767cb4da7664937aadecafa78377ea5)` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:10.671288 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee8b3b5-a084-4cea-a993-bd5c8fe8182d None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:10.676034 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 194/408] 10.222.0.66 () {56 vars in 1180 bytes} [Mon Jul 25 21:22:10 2022] GET /identity/v3/groups/2767cb4da7664937aadecafa78377ea5 => generated 226 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:10.678438 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee8b3b5-a084-4cea-a993-bd5c8fe8182d None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:10.800100 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c525aa8-3da4-4f4d-b8e1-c363fe6c4d5b None None] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:10.877185 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee8b3b5-a084-4cea-a993-bd5c8fe8182d None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:10.880946 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1952306-1985-4b6e-92cd-47eeb5666eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:10.881701 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1952306-1985-4b6e-92cd-47eeb5666eec None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:10.881981 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1952306-1985-4b6e-92cd-47eeb5666eec None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:10.882304 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1952306-1985-4b6e-92cd-47eeb5666eec None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:10.900133 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1952306-1985-4b6e-92cd-47eeb5666eec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:22:10.905335 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application [None req-e1952306-1985-4b6e-92cd-47eeb5666eec None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 21:22:10.905335 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:22:10.905335 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:22:10.905335 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:22:10.905335 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:22:10.905335 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:22:10.905335 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:22:10.905335 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:22:10.905335 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:22:10.905335 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:22:10.905335 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:22:10.905335 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:22:10.905335 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:22:10.905335 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:22:10.905335 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:22:10.905335 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:22:10.906235 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:22:10.906235 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:22:10.906235 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:22:10.906235 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:22:10.906235 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:22:10.906235 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:22:10.906235 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:22:10.906235 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:22:10.906235 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:22:10.906235 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:22:10.906235 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:22:10.906235 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application with Lock( Jul 25 21:22:10.906235 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:22:10.906235 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:22:10.906235 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:22:10.906235 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:22:10.907049 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:22:10.907049 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:22:10.907049 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:22:10.907049 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:22:10.907049 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:22:10.907049 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:22:10.907049 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:22:10.907049 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:22:10.907049 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:22:10.907049 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:22:10.907049 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 21:22:10.907049 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Jul 25 21:22:10.911890 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 215/409] 10.222.0.66 () {56 vars in 1096 bytes} [Mon Jul 25 21:22:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 21:22:10.914405 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1952306-1985-4b6e-92cd-47eeb5666eec None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:10.946161 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06d1786-2bfc-47a2-b113-25708e4498f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:10.947255 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06d1786-2bfc-47a2-b113-25708e4498f3 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:10.947255 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06d1786-2bfc-47a2-b113-25708e4498f3 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:10.947540 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06d1786-2bfc-47a2-b113-25708e4498f3 None admin] PATH_INFO: `/v3/projects/75f1c39fe6504f958e7eea5381109120` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:10.948775 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06d1786-2bfc-47a2-b113-25708e4498f3 None admin] RBAC: Authorizing `identity:get_project(project_id=75f1c39fe6504f958e7eea5381109120)` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:10.950605 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06d1786-2bfc-47a2-b113-25708e4498f3 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:10.952306 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 195/410] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Jul 25 21:22:10 2022] GET /identity/v3/projects/75f1c39fe6504f958e7eea5381109120 => generated 302 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:10.953502 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ba5647-17ec-438a-9036-f4038456996c None None] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:10.953781 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ba5647-17ec-438a-9036-f4038456996c None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:10.954052 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ba5647-17ec-438a-9036-f4038456996c None None] PATH_INFO: `/` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:10.960021 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 196/411] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:22:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:22:10.960021 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ba5647-17ec-438a-9036-f4038456996c None None] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:11.010533 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:11.048123 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:11.056007 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1952306-1985-4b6e-92cd-47eeb5666eec None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:11.073707 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ba5647-17ec-438a-9036-f4038456996c None None] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:11.091922 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cf1552-2986-4d77-b650-58af556f11aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:11.092553 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cf1552-2986-4d77-b650-58af556f11aa None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:11.092836 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cf1552-2986-4d77-b650-58af556f11aa None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:11.093135 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cf1552-2986-4d77-b650-58af556f11aa None admin] PATH_INFO: `/v3/roles` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:11.093848 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cf1552-2986-4d77-b650-58af556f11aa None admin] RBAC: Adding query filter params (name=admin) {{(pid=87209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:11.094149 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cf1552-2986-4d77-b650-58af556f11aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:11.095720 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cf1552-2986-4d77-b650-58af556f11aa None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:11.109157 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 216/412] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Jul 25 21:22:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:11.109157 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cedf60-91e8-487d-9e89-dd909c054d16 None None] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:11.109157 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cedf60-91e8-487d-9e89-dd909c054d16 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:11.109157 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cedf60-91e8-487d-9e89-dd909c054d16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:11.114421 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf5400f-2f68-458b-bc33-da84da25de6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:11.116132 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf5400f-2f68-458b-bc33-da84da25de6f None admin] REQUEST_METHOD: `PUT` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:11.116421 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf5400f-2f68-458b-bc33-da84da25de6f None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:11.116705 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf5400f-2f68-458b-bc33-da84da25de6f None admin] PATH_INFO: `/v3/projects/75f1c39fe6504f958e7eea5381109120/groups/2767cb4da7664937aadecafa78377ea5/roles/f910595b432f450eb4b382e0c99cf932` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:11.119037 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf5400f-2f68-458b-bc33-da84da25de6f None admin] RBAC: Authorizing `identity:create_grant(project_id=75f1c39fe6504f958e7eea5381109120, group_id=2767cb4da7664937aadecafa78377ea5, role_id=f910595b432f450eb4b382e0c99cf932)` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:11.120535 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf5400f-2f68-458b-bc33-da84da25de6f None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:11.126029 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.auth.core [None req-c9cedf60-91e8-487d-9e89-dd909c054d16 None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:22:11.127480 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-c9cedf60-91e8-487d-9e89-dd909c054d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:22:11.136450 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 197/413] 10.222.0.66 () {58 vars in 1442 bytes} [Mon Jul 25 21:22:10 2022] PUT /identity/v3/projects/75f1c39fe6504f958e7eea5381109120/groups/2767cb4da7664937aadecafa78377ea5/roles/f910595b432f450eb4b382e0c99cf932 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 21:22:11.138387 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b34ca6a-ca92-4746-9a6e-4bd8335cc86f None None] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:11.139119 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b34ca6a-ca92-4746-9a6e-4bd8335cc86f None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:11.139662 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b34ca6a-ca92-4746-9a6e-4bd8335cc86f None None] PATH_INFO: `/` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:11.141776 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 198/414] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:22:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:22:11.142992 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b34ca6a-ca92-4746-9a6e-4bd8335cc86f None None] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:11.210987 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 217/415] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:22:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:22:11.212812 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9c9ed9-70a0-4f9c-9c08-20653178f64a None None] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:11.213400 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9c9ed9-70a0-4f9c-9c08-20653178f64a None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:11.213820 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9c9ed9-70a0-4f9c-9c08-20653178f64a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:11.234770 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.auth.core [None req-fe9c9ed9-70a0-4f9c-9c08-20653178f64a None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:22:11.236272 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-fe9c9ed9-70a0-4f9c-9c08-20653178f64a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:22:11.272212 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:11.277624 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b34ca6a-ca92-4746-9a6e-4bd8335cc86f None None] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:11.322412 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 218/416] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:22:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:22:11.323760 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9c9ed9-70a0-4f9c-9c08-20653178f64a None None] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:11.326012 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ae70ff-77bc-48b7-ae00-dd958e821c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:11.326841 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ae70ff-77bc-48b7-ae00-dd958e821c6f None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:11.327129 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ae70ff-77bc-48b7-ae00-dd958e821c6f None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:11.327694 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ae70ff-77bc-48b7-ae00-dd958e821c6f None admin] PATH_INFO: `/v3/groups/23070abab6f649c9a657de3e19fa7f27` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:11.329231 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ae70ff-77bc-48b7-ae00-dd958e821c6f None admin] RBAC: Authorizing `identity:get_group(group_id=23070abab6f649c9a657de3e19fa7f27)` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:11.332124 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ae70ff-77bc-48b7-ae00-dd958e821c6f None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:11.337693 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 199/417] 10.222.0.66 () {56 vars in 1180 bytes} [Mon Jul 25 21:22:11 2022] GET /identity/v3/groups/23070abab6f649c9a657de3e19fa7f27 => generated 229 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:11.343733 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ae70ff-77bc-48b7-ae00-dd958e821c6f None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:11.361579 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:11.466981 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9c9ed9-70a0-4f9c-9c08-20653178f64a None None] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:11.472016 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ae70ff-77bc-48b7-ae00-dd958e821c6f None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:11.511852 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd40870-5d31-46e5-bd2d-2c1fafda9e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:11.512100 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9e5609-0ac8-462d-949e-74a16656c551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:11.512615 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd40870-5d31-46e5-bd2d-2c1fafda9e2a None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:11.512961 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd40870-5d31-46e5-bd2d-2c1fafda9e2a None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:11.513341 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd40870-5d31-46e5-bd2d-2c1fafda9e2a None admin] PATH_INFO: `/v3/roles/member` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:11.513631 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9e5609-0ac8-462d-949e-74a16656c551 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:11.514074 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9e5609-0ac8-462d-949e-74a16656c551 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:11.514481 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9e5609-0ac8-462d-949e-74a16656c551 None admin] PATH_INFO: `/v3/projects/fa9501d798e8481da3be76351eec2bf6` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:11.516045 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9e5609-0ac8-462d-949e-74a16656c551 None admin] RBAC: Authorizing `identity:get_project(project_id=fa9501d798e8481da3be76351eec2bf6)` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:11.518353 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9e5609-0ac8-462d-949e-74a16656c551 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:11.520540 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 200/418] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Jul 25 21:22:11 2022] GET /identity/v3/projects/fa9501d798e8481da3be76351eec2bf6 => generated 344 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:22:11.521618 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9e5609-0ac8-462d-949e-74a16656c551 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:11.525836 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd40870-5d31-46e5-bd2d-2c1fafda9e2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:22:11.531017 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application [None req-5dd40870-5d31-46e5-bd2d-2c1fafda9e2a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 21:22:11.531017 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:22:11.531017 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:22:11.531017 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:22:11.531017 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:22:11.531017 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:22:11.531017 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:22:11.531017 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:22:11.531017 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:22:11.531017 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:22:11.531017 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:22:11.531017 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:22:11.531017 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:22:11.531017 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:22:11.531017 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:22:11.531017 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:22:11.532096 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:22:11.532096 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:22:11.532096 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:22:11.532096 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:22:11.532096 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:22:11.532096 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:22:11.532096 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:22:11.532096 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:22:11.532096 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:22:11.532096 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:22:11.532096 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:22:11.532096 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application with Lock( Jul 25 21:22:11.532096 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:22:11.532096 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:22:11.532096 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:22:11.532096 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:22:11.533191 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:22:11.533191 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:22:11.533191 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:22:11.533191 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:22:11.533191 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:22:11.533191 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:22:11.533191 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:22:11.533191 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:22:11.533191 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:22:11.533191 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:22:11.533191 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 21:22:11.533191 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Jul 25 21:22:11.534690 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 219/419] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Jul 25 21:22:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:22:11.535343 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd40870-5d31-46e5-bd2d-2c1fafda9e2a None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:11.574787 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:11.650775 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9e5609-0ac8-462d-949e-74a16656c551 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:11.651126 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:11.682059 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd40870-5d31-46e5-bd2d-2c1fafda9e2a None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:11.692298 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e022b09-75c0-4126-ad8b-4e1ef554be19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:11.693043 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e022b09-75c0-4126-ad8b-4e1ef554be19 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:11.693434 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e022b09-75c0-4126-ad8b-4e1ef554be19 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:11.693775 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e022b09-75c0-4126-ad8b-4e1ef554be19 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:11.704864 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e022b09-75c0-4126-ad8b-4e1ef554be19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:22:11.710189 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application [None req-1e022b09-75c0-4126-ad8b-4e1ef554be19 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 21:22:11.710189 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:22:11.710189 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:22:11.710189 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:22:11.710189 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:22:11.710189 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:22:11.710189 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:22:11.710189 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:22:11.710189 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:22:11.710189 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:22:11.710189 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:22:11.710189 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:22:11.710189 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:22:11.710189 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:22:11.710189 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:22:11.710189 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:22:11.711092 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:22:11.711092 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:22:11.711092 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:22:11.711092 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:22:11.711092 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:22:11.711092 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:22:11.711092 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:22:11.711092 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:22:11.711092 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:22:11.711092 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:22:11.711092 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:22:11.711092 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application with Lock( Jul 25 21:22:11.711092 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:22:11.711092 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:22:11.711092 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:22:11.711092 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:22:11.712187 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:22:11.712187 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:22:11.712187 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:22:11.712187 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:22:11.712187 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:22:11.712187 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:22:11.712187 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:22:11.712187 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:22:11.712187 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:22:11.712187 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:22:11.712187 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 21:22:11.712187 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Jul 25 21:22:11.712187 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 201/420] 10.222.0.66 () {56 vars in 1114 bytes} [Mon Jul 25 21:22:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:22:11.713294 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e022b09-75c0-4126-ad8b-4e1ef554be19 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:11.731814 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905c260c-401b-477d-8761-02ce47d2ca66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:11.733144 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905c260c-401b-477d-8761-02ce47d2ca66 None admin] REQUEST_METHOD: `PUT` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:11.733596 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905c260c-401b-477d-8761-02ce47d2ca66 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:11.734287 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905c260c-401b-477d-8761-02ce47d2ca66 None admin] PATH_INFO: `/v3/projects/fa9501d798e8481da3be76351eec2bf6/groups/23070abab6f649c9a657de3e19fa7f27/roles/216a86497a3a4593ba08730ea8697df3` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:11.736986 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905c260c-401b-477d-8761-02ce47d2ca66 None admin] RBAC: Authorizing `identity:create_grant(project_id=fa9501d798e8481da3be76351eec2bf6, group_id=23070abab6f649c9a657de3e19fa7f27, role_id=216a86497a3a4593ba08730ea8697df3)` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:11.739335 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905c260c-401b-477d-8761-02ce47d2ca66 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:11.758152 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 220/421] 10.222.0.66 () {58 vars in 1442 bytes} [Mon Jul 25 21:22:11 2022] PUT /identity/v3/projects/fa9501d798e8481da3be76351eec2bf6/groups/23070abab6f649c9a657de3e19fa7f27/roles/216a86497a3a4593ba08730ea8697df3 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 21:22:11.759484 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905c260c-401b-477d-8761-02ce47d2ca66 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:11.912100 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905c260c-401b-477d-8761-02ce47d2ca66 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:11.921383 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:11.939462 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e022b09-75c0-4126-ad8b-4e1ef554be19 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:11.973531 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d863ffa-5b22-40f6-8087-e24e7b2814a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:11.974559 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d863ffa-5b22-40f6-8087-e24e7b2814a9 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:11.975047 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d863ffa-5b22-40f6-8087-e24e7b2814a9 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:11.975506 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d863ffa-5b22-40f6-8087-e24e7b2814a9 None admin] PATH_INFO: `/v3/roles` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:11.976506 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d863ffa-5b22-40f6-8087-e24e7b2814a9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:11.977111 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d863ffa-5b22-40f6-8087-e24e7b2814a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:11.979406 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d863ffa-5b22-40f6-8087-e24e7b2814a9 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:11.984151 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:11.998014 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 221/422] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Jul 25 21:22:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:12.008186 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d863ffa-5b22-40f6-8087-e24e7b2814a9 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:12.018435 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9df570-c410-49ec-91de-d8ae1146bbdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:12.019186 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9df570-c410-49ec-91de-d8ae1146bbdf None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:12.019467 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9df570-c410-49ec-91de-d8ae1146bbdf None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:12.019737 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9df570-c410-49ec-91de-d8ae1146bbdf None admin] PATH_INFO: `/v3/roles` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:12.020457 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9df570-c410-49ec-91de-d8ae1146bbdf None admin] RBAC: Adding query filter params (name=member) {{(pid=87210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:12.020762 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9df570-c410-49ec-91de-d8ae1146bbdf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:12.023082 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9df570-c410-49ec-91de-d8ae1146bbdf None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:12.033517 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 202/423] 10.222.0.66 () {56 vars in 1101 bytes} [Mon Jul 25 21:22:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:12.039312 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9df570-c410-49ec-91de-d8ae1146bbdf None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:12.155556 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d863ffa-5b22-40f6-8087-e24e7b2814a9 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:12.168508 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9df570-c410-49ec-91de-d8ae1146bbdf None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:12.222283 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903aec73-bb39-47e6-ac5e-28093433a54f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:12.222919 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903aec73-bb39-47e6-ac5e-28093433a54f None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:12.223200 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903aec73-bb39-47e6-ac5e-28093433a54f None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:12.223470 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903aec73-bb39-47e6-ac5e-28093433a54f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:12.234355 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0597ee-b66d-4d11-8791-5b2abcc37291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:12.234996 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0597ee-b66d-4d11-8791-5b2abcc37291 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:12.235276 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0597ee-b66d-4d11-8791-5b2abcc37291 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:12.235633 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0597ee-b66d-4d11-8791-5b2abcc37291 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:12.267383 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:12.304797 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:12.308737 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903aec73-bb39-47e6-ac5e-28093433a54f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:12.310267 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903aec73-bb39-47e6-ac5e-28093433a54f None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:12.318970 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0597ee-b66d-4d11-8791-5b2abcc37291 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:12.321177 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0597ee-b66d-4d11-8791-5b2abcc37291 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:12.418862 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 222/424] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Jul 25 21:22:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 21:22:12.430308 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903aec73-bb39-47e6-ac5e-28093433a54f None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:12.433297 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 203/425] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Jul 25 21:22:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 25 21:22:12.452765 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0597ee-b66d-4d11-8791-5b2abcc37291 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:12.558333 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:12.604792 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:12.608098 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0597ee-b66d-4d11-8791-5b2abcc37291 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:12.610223 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903aec73-bb39-47e6-ac5e-28093433a54f None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:12.645113 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bebbc60-b8b8-4061-873f-2a67de37edd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:12.645888 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bebbc60-b8b8-4061-873f-2a67de37edd5 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:12.646234 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bebbc60-b8b8-4061-873f-2a67de37edd5 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:12.646572 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bebbc60-b8b8-4061-873f-2a67de37edd5 None admin] PATH_INFO: `/v3/projects/d8086440d31c4402a8800ca68927d7e1` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:12.647816 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bebbc60-b8b8-4061-873f-2a67de37edd5 None admin] RBAC: Authorizing `identity:get_project(project_id=d8086440d31c4402a8800ca68927d7e1)` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:12.649377 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bebbc60-b8b8-4061-873f-2a67de37edd5 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:12.649701 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f464a27-5edb-45c3-abd1-955c7c560b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:12.650357 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f464a27-5edb-45c3-abd1-955c7c560b30 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:12.650637 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f464a27-5edb-45c3-abd1-955c7c560b30 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:12.650903 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f464a27-5edb-45c3-abd1-955c7c560b30 None admin] PATH_INFO: `/v3/projects/d8086440d31c4402a8800ca68927d7e1` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:12.651728 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 204/426] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Jul 25 21:22:12 2022] GET /identity/v3/projects/d8086440d31c4402a8800ca68927d7e1 => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:22:12.652976 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b928172-cbaf-46e3-81fd-2e9ab1be74a2 None None] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:12.653346 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b928172-cbaf-46e3-81fd-2e9ab1be74a2 None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:12.653683 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b928172-cbaf-46e3-81fd-2e9ab1be74a2 None None] PATH_INFO: `/` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:12.656672 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f464a27-5edb-45c3-abd1-955c7c560b30 None admin] RBAC: Authorizing `identity:get_project(project_id=d8086440d31c4402a8800ca68927d7e1)` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:12.658304 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f464a27-5edb-45c3-abd1-955c7c560b30 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:12.659544 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 205/427] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:22:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:22:12.660348 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 223/428] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Jul 25 21:22:12 2022] GET /identity/v3/projects/d8086440d31c4402a8800ca68927d7e1 => generated 298 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:12.660454 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b928172-cbaf-46e3-81fd-2e9ab1be74a2 None None] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:12.661558 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e43a614-5660-4a94-831c-23e1cc24351c None None] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:12.661831 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e43a614-5660-4a94-831c-23e1cc24351c None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:12.662097 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e43a614-5660-4a94-831c-23e1cc24351c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:12.682319 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.auth.core [None req-9e43a614-5660-4a94-831c-23e1cc24351c None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:22:12.683525 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-9e43a614-5660-4a94-831c-23e1cc24351c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:22:12.757045 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 224/429] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:22:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:22:12.757947 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e43a614-5660-4a94-831c-23e1cc24351c None None] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:12.777663 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b928172-cbaf-46e3-81fd-2e9ab1be74a2 None None] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:12.815094 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:12.829223 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad3ec2c-5f27-41ee-a6c6-6057e4350154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:12.829988 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad3ec2c-5f27-41ee-a6c6-6057e4350154 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:12.830332 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad3ec2c-5f27-41ee-a6c6-6057e4350154 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:12.830706 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad3ec2c-5f27-41ee-a6c6-6057e4350154 None admin] PATH_INFO: `/v3/groups/2767cb4da7664937aadecafa78377ea5` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:12.831981 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad3ec2c-5f27-41ee-a6c6-6057e4350154 None admin] RBAC: Authorizing `identity:get_group(group_id=2767cb4da7664937aadecafa78377ea5)` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:12.833531 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad3ec2c-5f27-41ee-a6c6-6057e4350154 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:12.835536 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 206/430] 10.222.0.66 () {56 vars in 1180 bytes} [Mon Jul 25 21:22:12 2022] GET /identity/v3/groups/2767cb4da7664937aadecafa78377ea5 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:12.836362 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad3ec2c-5f27-41ee-a6c6-6057e4350154 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:12.864316 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:12.871362 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e43a614-5660-4a94-831c-23e1cc24351c None None] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:12.907425 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb12bd18-f403-472a-8678-53460f8be462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:12.908143 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb12bd18-f403-472a-8678-53460f8be462 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:12.908509 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb12bd18-f403-472a-8678-53460f8be462 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:12.908844 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb12bd18-f403-472a-8678-53460f8be462 None admin] PATH_INFO: `/v3/groups/2767cb4da7664937aadecafa78377ea5` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:12.910036 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb12bd18-f403-472a-8678-53460f8be462 None admin] RBAC: Authorizing `identity:get_group(group_id=2767cb4da7664937aadecafa78377ea5)` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:12.911575 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb12bd18-f403-472a-8678-53460f8be462 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:12.913606 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 225/431] 10.222.0.66 () {56 vars in 1180 bytes} [Mon Jul 25 21:22:12 2022] GET /identity/v3/groups/2767cb4da7664937aadecafa78377ea5 => generated 226 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:12.914437 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb12bd18-f403-472a-8678-53460f8be462 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:12.948934 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad3ec2c-5f27-41ee-a6c6-6057e4350154 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:12.985012 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be38f3c7-b9ea-4c57-95ac-f76c127ac719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:12.986004 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be38f3c7-b9ea-4c57-95ac-f76c127ac719 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:12.986507 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be38f3c7-b9ea-4c57-95ac-f76c127ac719 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:12.986915 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be38f3c7-b9ea-4c57-95ac-f76c127ac719 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:12.997885 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be38f3c7-b9ea-4c57-95ac-f76c127ac719 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:22:13.003425 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application [None req-be38f3c7-b9ea-4c57-95ac-f76c127ac719 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 21:22:13.003425 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:22:13.003425 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:22:13.003425 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:22:13.003425 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:22:13.003425 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:22:13.003425 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:22:13.003425 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:22:13.003425 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:22:13.003425 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:22:13.003425 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:22:13.003425 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:22:13.003425 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:22:13.003425 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:22:13.003425 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:22:13.003425 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:22:13.004524 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:22:13.004524 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:22:13.004524 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:22:13.004524 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:22:13.004524 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:22:13.004524 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:22:13.004524 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:22:13.004524 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:22:13.004524 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:22:13.004524 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:22:13.004524 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:22:13.004524 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application with Lock( Jul 25 21:22:13.004524 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:22:13.004524 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:22:13.004524 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:22:13.004524 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:22:13.005556 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:22:13.005556 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:22:13.005556 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:22:13.005556 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:22:13.005556 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:22:13.005556 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:22:13.005556 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:22:13.005556 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:22:13.005556 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:22:13.005556 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:22:13.005556 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 21:22:13.005556 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Jul 25 21:22:13.007706 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 207/432] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Jul 25 21:22:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:22:13.013260 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be38f3c7-b9ea-4c57-95ac-f76c127ac719 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:13.029233 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb12bd18-f403-472a-8678-53460f8be462 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:13.067140 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682c6b6b-9e54-4f63-b4bb-c1649f508afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:13.067778 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682c6b6b-9e54-4f63-b4bb-c1649f508afc None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:13.068149 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682c6b6b-9e54-4f63-b4bb-c1649f508afc None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:13.068423 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682c6b6b-9e54-4f63-b4bb-c1649f508afc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:13.069236 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682c6b6b-9e54-4f63-b4bb-c1649f508afc None admin] RBAC: Adding query filter params (group.id=2767cb4da7664937aadecafa78377ea5, role.id=faec70ea0ba040efa587f542f054e49e, scope.project.id=d8086440d31c4402a8800ca68927d7e1) {{(pid=87209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:13.069542 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682c6b6b-9e54-4f63-b4bb-c1649f508afc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:13.071163 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:13.071805 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682c6b6b-9e54-4f63-b4bb-c1649f508afc None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:13.080313 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 226/433] 10.222.0.66 () {56 vars in 1376 bytes} [Mon Jul 25 21:22:12 2022] GET /identity/v3/role_assignments?group.id=2767cb4da7664937aadecafa78377ea5&scope.project.id=d8086440d31c4402a8800ca68927d7e1&role.id=faec70ea0ba040efa587f542f054e49e => generated 611 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:13.081373 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682c6b6b-9e54-4f63-b4bb-c1649f508afc None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:13.114221 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:13.184186 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be38f3c7-b9ea-4c57-95ac-f76c127ac719 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:13.200106 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682c6b6b-9e54-4f63-b4bb-c1649f508afc None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:13.239146 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18aaf3b-fd5c-418d-ade0-8b9a01f7896b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:13.240027 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18aaf3b-fd5c-418d-ade0-8b9a01f7896b None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:13.240480 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18aaf3b-fd5c-418d-ade0-8b9a01f7896b None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:13.240940 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18aaf3b-fd5c-418d-ade0-8b9a01f7896b None admin] PATH_INFO: `/v3/roles` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:13.241857 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18aaf3b-fd5c-418d-ade0-8b9a01f7896b None admin] RBAC: Adding query filter params (name=member) {{(pid=87209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:13.242295 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18aaf3b-fd5c-418d-ade0-8b9a01f7896b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:13.243818 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18aaf3b-fd5c-418d-ade0-8b9a01f7896b None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:13.254191 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 227/434] 10.222.0.66 () {56 vars in 1101 bytes} [Mon Jul 25 21:22:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:13.260280 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18aaf3b-fd5c-418d-ade0-8b9a01f7896b None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:13.282217 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3866d985-c5c3-44de-8689-c9b6bcfdeb95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:13.282994 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3866d985-c5c3-44de-8689-c9b6bcfdeb95 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:13.283458 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3866d985-c5c3-44de-8689-c9b6bcfdeb95 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:13.283738 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3866d985-c5c3-44de-8689-c9b6bcfdeb95 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:13.284552 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3866d985-c5c3-44de-8689-c9b6bcfdeb95 None admin] RBAC: Adding query filter params (group.id=2767cb4da7664937aadecafa78377ea5, role.id=f910595b432f450eb4b382e0c99cf932, scope.project.id=d8086440d31c4402a8800ca68927d7e1) {{(pid=87210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:13.284866 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3866d985-c5c3-44de-8689-c9b6bcfdeb95 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:13.286381 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3866d985-c5c3-44de-8689-c9b6bcfdeb95 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:13.307760 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 208/435] 10.222.0.66 () {56 vars in 1376 bytes} [Mon Jul 25 21:22:13 2022] GET /identity/v3/role_assignments?group.id=2767cb4da7664937aadecafa78377ea5&scope.project.id=d8086440d31c4402a8800ca68927d7e1&role.id=f910595b432f450eb4b382e0c99cf932 => generated 611 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:13.372284 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:13.383133 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18aaf3b-fd5c-418d-ade0-8b9a01f7896b None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:13.430447 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a000ba-f02a-4290-8fef-32e749a7ef81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:13.431394 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a000ba-f02a-4290-8fef-32e749a7ef81 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:13.431813 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a000ba-f02a-4290-8fef-32e749a7ef81 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:13.432218 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a000ba-f02a-4290-8fef-32e749a7ef81 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:13.517275 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a000ba-f02a-4290-8fef-32e749a7ef81 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:13.519035 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a000ba-f02a-4290-8fef-32e749a7ef81 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:13.621465 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:13.632915 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 228/436] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Jul 25 21:22:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 25 21:22:13.638698 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3866d985-c5c3-44de-8689-c9b6bcfdeb95 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:13.765824 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3866d985-c5c3-44de-8689-c9b6bcfdeb95 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:13.784690 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:13.805574 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ba7d4e-0072-4971-93e5-71210f2bc487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:13.806238 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ba7d4e-0072-4971-93e5-71210f2bc487 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:13.806518 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ba7d4e-0072-4971-93e5-71210f2bc487 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:13.806788 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ba7d4e-0072-4971-93e5-71210f2bc487 None admin] PATH_INFO: `/v3/projects/75f1c39fe6504f958e7eea5381109120` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:13.808599 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ba7d4e-0072-4971-93e5-71210f2bc487 None admin] RBAC: Authorizing `identity:get_project(project_id=75f1c39fe6504f958e7eea5381109120)` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:13.810092 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ba7d4e-0072-4971-93e5-71210f2bc487 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:13.811956 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 209/437] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Jul 25 21:22:13 2022] GET /identity/v3/projects/75f1c39fe6504f958e7eea5381109120 => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:13.817845 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a000ba-f02a-4290-8fef-32e749a7ef81 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:13.899057 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6072fe-4ade-4dd8-9428-80f1d8c6f8e7 None None] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:13.899378 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6072fe-4ade-4dd8-9428-80f1d8c6f8e7 None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:13.899608 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6072fe-4ade-4dd8-9428-80f1d8c6f8e7 None None] PATH_INFO: `/` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:13.901118 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 210/438] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:22:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 21:22:13.906040 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a250c367-aed2-4d15-b0c9-e201ad369706 None None] REQUEST_METHOD: `POST` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:13.906326 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a250c367-aed2-4d15-b0c9-e201ad369706 None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:13.906605 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a250c367-aed2-4d15-b0c9-e201ad369706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:13.926884 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.auth.core [None req-a250c367-aed2-4d15-b0c9-e201ad369706 None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:22:13.928102 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.fernet_utils [None req-a250c367-aed2-4d15-b0c9-e201ad369706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:22:13.952809 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a000ba-f02a-4290-8fef-32e749a7ef81 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:14.003496 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93859e5f-e3fb-49b7-b724-7e1e6dc34819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:14.004173 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93859e5f-e3fb-49b7-b724-7e1e6dc34819 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:14.004452 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93859e5f-e3fb-49b7-b724-7e1e6dc34819 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:14.004742 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93859e5f-e3fb-49b7-b724-7e1e6dc34819 None admin] PATH_INFO: `/v3/groups/2767cb4da7664937aadecafa78377ea5` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:14.005948 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93859e5f-e3fb-49b7-b724-7e1e6dc34819 None admin] RBAC: Authorizing `identity:get_group(group_id=2767cb4da7664937aadecafa78377ea5)` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:14.007413 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93859e5f-e3fb-49b7-b724-7e1e6dc34819 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:14.009246 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 229/439] 10.222.0.66 () {56 vars in 1180 bytes} [Mon Jul 25 21:22:13 2022] GET /identity/v3/groups/2767cb4da7664937aadecafa78377ea5 => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:14.014870 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93859e5f-e3fb-49b7-b724-7e1e6dc34819 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:14.015249 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 211/440] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:22:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 21:22:14.039614 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a250c367-aed2-4d15-b0c9-e201ad369706 None None] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:14.082153 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:14.135292 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93859e5f-e3fb-49b7-b724-7e1e6dc34819 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:14.148653 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a250c367-aed2-4d15-b0c9-e201ad369706 None None] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:14.163003 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:14.173821 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b244fdbe-1e9a-4eb2-8021-d4b75ad0101d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:14.174770 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b244fdbe-1e9a-4eb2-8021-d4b75ad0101d None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:14.175225 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b244fdbe-1e9a-4eb2-8021-d4b75ad0101d None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:14.175695 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b244fdbe-1e9a-4eb2-8021-d4b75ad0101d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:14.176646 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b244fdbe-1e9a-4eb2-8021-d4b75ad0101d None admin] RBAC: Adding query filter params (group.id=2767cb4da7664937aadecafa78377ea5, role.id=faec70ea0ba040efa587f542f054e49e, scope.project.id=75f1c39fe6504f958e7eea5381109120) {{(pid=87209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:14.177160 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b244fdbe-1e9a-4eb2-8021-d4b75ad0101d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:14.178849 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b244fdbe-1e9a-4eb2-8021-d4b75ad0101d None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:14.184744 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0655f1-a490-4804-a685-24810b66c6a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:14.185531 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0655f1-a490-4804-a685-24810b66c6a4 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:14.185696 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0655f1-a490-4804-a685-24810b66c6a4 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:14.185988 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0655f1-a490-4804-a685-24810b66c6a4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:14.186125 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 230/441] 10.222.0.66 () {56 vars in 1376 bytes} [Mon Jul 25 21:22:14 2022] GET /identity/v3/role_assignments?group.id=2767cb4da7664937aadecafa78377ea5&scope.project.id=75f1c39fe6504f958e7eea5381109120&role.id=faec70ea0ba040efa587f542f054e49e => generated 611 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:22:14.207718 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0655f1-a490-4804-a685-24810b66c6a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:22:14.212806 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application [None req-0b0655f1-a490-4804-a685-24810b66c6a4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 21:22:14.212806 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:22:14.212806 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:22:14.212806 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:22:14.212806 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:22:14.212806 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:22:14.212806 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:22:14.212806 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:22:14.212806 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:22:14.212806 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:22:14.212806 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:22:14.212806 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:22:14.212806 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:22:14.212806 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:22:14.212806 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:22:14.212806 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:22:14.213773 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:22:14.213773 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:22:14.213773 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:22:14.213773 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:22:14.213773 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:22:14.213773 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:22:14.213773 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:22:14.213773 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:22:14.213773 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:22:14.213773 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:22:14.213773 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:22:14.213773 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application with Lock( Jul 25 21:22:14.213773 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:22:14.213773 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:22:14.213773 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:22:14.213773 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:22:14.214653 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:22:14.214653 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:22:14.214653 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:22:14.214653 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:22:14.214653 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:22:14.214653 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:22:14.214653 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:22:14.214653 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:22:14.214653 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:22:14.214653 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:22:14.214653 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 21:22:14.214653 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Jul 25 21:22:14.214653 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 212/442] 10.222.0.66 () {56 vars in 1114 bytes} [Mon Jul 25 21:22:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 21:22:14.220157 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b244fdbe-1e9a-4eb2-8021-d4b75ad0101d None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:14.244869 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af237f4-3297-4369-9e34-415735f66baf None None] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:14.245280 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af237f4-3297-4369-9e34-415735f66baf None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:14.245557 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af237f4-3297-4369-9e34-415735f66baf None None] PATH_INFO: `/` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:14.246947 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 213/443] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:22:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:22:14.253382 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3669bb09-8b9a-4a98-94de-62ea7cf26590 None None] REQUEST_METHOD: `POST` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:14.253911 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3669bb09-8b9a-4a98-94de-62ea7cf26590 None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:14.254189 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3669bb09-8b9a-4a98-94de-62ea7cf26590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:14.274143 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.auth.core [None req-3669bb09-8b9a-4a98-94de-62ea7cf26590 None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:22:14.275401 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.fernet_utils [None req-3669bb09-8b9a-4a98-94de-62ea7cf26590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:22:14.336123 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b244fdbe-1e9a-4eb2-8021-d4b75ad0101d None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:14.353040 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 214/444] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:22:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 21:22:14.362073 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:14.376487 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9fbfe8-06af-4fdd-bc98-51dc6b52e0b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:14.377030 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9fbfe8-06af-4fdd-bc98-51dc6b52e0b4 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:14.377346 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9fbfe8-06af-4fdd-bc98-51dc6b52e0b4 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:14.377622 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9fbfe8-06af-4fdd-bc98-51dc6b52e0b4 None admin] PATH_INFO: `/v3/roles` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:14.377716 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3669bb09-8b9a-4a98-94de-62ea7cf26590 None None] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:14.378345 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9fbfe8-06af-4fdd-bc98-51dc6b52e0b4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:14.378647 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9fbfe8-06af-4fdd-bc98-51dc6b52e0b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:14.380037 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9fbfe8-06af-4fdd-bc98-51dc6b52e0b4 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:14.388711 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 231/445] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Jul 25 21:22:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:22:14.394742 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9fbfe8-06af-4fdd-bc98-51dc6b52e0b4 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:14.499556 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3669bb09-8b9a-4a98-94de-62ea7cf26590 None None] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:14.502065 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:14.522443 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9fbfe8-06af-4fdd-bc98-51dc6b52e0b4 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:14.543742 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f8eef8-6328-4f31-a41b-6b7c53491216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:14.544405 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f8eef8-6328-4f31-a41b-6b7c53491216 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:14.544689 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f8eef8-6328-4f31-a41b-6b7c53491216 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:14.544961 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f8eef8-6328-4f31-a41b-6b7c53491216 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:14.557883 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f8eef8-6328-4f31-a41b-6b7c53491216 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:22:14.563376 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application [None req-25f8eef8-6328-4f31-a41b-6b7c53491216 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 21:22:14.563376 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:22:14.563376 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:22:14.563376 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:22:14.563376 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:22:14.563376 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:22:14.563376 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:22:14.563376 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:22:14.563376 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:22:14.563376 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:22:14.563376 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:22:14.563376 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:22:14.563376 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:22:14.563376 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:22:14.563376 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:22:14.563376 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:22:14.564653 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:22:14.564653 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:22:14.564653 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:22:14.564653 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:22:14.564653 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:22:14.564653 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:22:14.564653 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:22:14.564653 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:22:14.564653 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:22:14.564653 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:22:14.564653 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:22:14.564653 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application with Lock( Jul 25 21:22:14.564653 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:22:14.564653 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:22:14.564653 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:22:14.564653 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:22:14.565790 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:22:14.565790 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:22:14.565790 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:22:14.565790 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:22:14.565790 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:22:14.565790 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:22:14.565790 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:22:14.565790 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:22:14.565790 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:22:14.565790 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:22:14.565790 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 21:22:14.565790 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Jul 25 21:22:14.565790 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 215/446] 10.222.0.66 () {56 vars in 1096 bytes} [Mon Jul 25 21:22:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:22:14.570704 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f8eef8-6328-4f31-a41b-6b7c53491216 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:14.572441 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4d7bce-bccf-42b5-a983-383db56f0842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:14.572441 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4d7bce-bccf-42b5-a983-383db56f0842 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:14.572441 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4d7bce-bccf-42b5-a983-383db56f0842 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:14.572441 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4d7bce-bccf-42b5-a983-383db56f0842 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:14.633423 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:14.649558 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4d7bce-bccf-42b5-a983-383db56f0842 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:14.651048 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4d7bce-bccf-42b5-a983-383db56f0842 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:14.676861 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f8eef8-6328-4f31-a41b-6b7c53491216 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:14.709953 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51a2594-02be-4e6b-bdf5-b5c33e68b8dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:14.710707 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51a2594-02be-4e6b-bdf5-b5c33e68b8dd None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:14.710989 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51a2594-02be-4e6b-bdf5-b5c33e68b8dd None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:14.711262 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51a2594-02be-4e6b-bdf5-b5c33e68b8dd None admin] PATH_INFO: `/v3/roles` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:14.712006 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51a2594-02be-4e6b-bdf5-b5c33e68b8dd None admin] RBAC: Adding query filter params (name=admin) {{(pid=87210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:14.712325 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51a2594-02be-4e6b-bdf5-b5c33e68b8dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:14.713765 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51a2594-02be-4e6b-bdf5-b5c33e68b8dd None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:14.722552 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 216/447] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Jul 25 21:22:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:14.728027 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51a2594-02be-4e6b-bdf5-b5c33e68b8dd None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:14.753382 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 232/448] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Jul 25 21:22:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 25 21:22:14.758051 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:14.759215 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4d7bce-bccf-42b5-a983-383db56f0842 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:14.835106 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51a2594-02be-4e6b-bdf5-b5c33e68b8dd None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:14.845984 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:14.862130 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4d7bce-bccf-42b5-a983-383db56f0842 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:14.869455 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02a63da-d6bb-4077-ac67-a7b5588b777e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:14.870082 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02a63da-d6bb-4077-ac67-a7b5588b777e None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:14.870360 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02a63da-d6bb-4077-ac67-a7b5588b777e None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:14.870634 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02a63da-d6bb-4077-ac67-a7b5588b777e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:14.900425 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cc5a9d-87dd-4feb-8133-96adc13a8970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:14.900989 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cc5a9d-87dd-4feb-8133-96adc13a8970 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:14.901312 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cc5a9d-87dd-4feb-8133-96adc13a8970 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:14.901582 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cc5a9d-87dd-4feb-8133-96adc13a8970 None admin] PATH_INFO: `/v3/projects/75f1c39fe6504f958e7eea5381109120` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:14.902744 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cc5a9d-87dd-4feb-8133-96adc13a8970 None admin] RBAC: Authorizing `identity:get_project(project_id=75f1c39fe6504f958e7eea5381109120)` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:14.904221 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cc5a9d-87dd-4feb-8133-96adc13a8970 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:14.906087 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 233/449] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Jul 25 21:22:14 2022] GET /identity/v3/projects/75f1c39fe6504f958e7eea5381109120 => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:22:14.912316 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cc5a9d-87dd-4feb-8133-96adc13a8970 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:14.951734 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02a63da-d6bb-4077-ac67-a7b5588b777e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:14.953238 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02a63da-d6bb-4077-ac67-a7b5588b777e None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:14.982484 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:15.015374 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cc5a9d-87dd-4feb-8133-96adc13a8970 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:15.049852 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b133ab3-62d4-49e7-b7ba-5f4e06a3e884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:15.050490 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b133ab3-62d4-49e7-b7ba-5f4e06a3e884 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:15.050764 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b133ab3-62d4-49e7-b7ba-5f4e06a3e884 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:15.051033 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b133ab3-62d4-49e7-b7ba-5f4e06a3e884 None admin] PATH_INFO: `/v3/groups/2767cb4da7664937aadecafa78377ea5` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:15.052194 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b133ab3-62d4-49e7-b7ba-5f4e06a3e884 None admin] RBAC: Authorizing `identity:get_group(group_id=2767cb4da7664937aadecafa78377ea5)` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:15.053773 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b133ab3-62d4-49e7-b7ba-5f4e06a3e884 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:15.055294 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 234/450] 10.222.0.66 () {56 vars in 1180 bytes} [Mon Jul 25 21:22:14 2022] GET /identity/v3/groups/2767cb4da7664937aadecafa78377ea5 => generated 226 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:22:15.058107 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 217/451] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Jul 25 21:22:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 25 21:22:15.061425 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b133ab3-62d4-49e7-b7ba-5f4e06a3e884 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:15.063366 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02a63da-d6bb-4077-ac67-a7b5588b777e None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:15.084595 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:15.162300 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02a63da-d6bb-4077-ac67-a7b5588b777e None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:15.162481 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b133ab3-62d4-49e7-b7ba-5f4e06a3e884 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:15.187834 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:15.197201 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a442656-d6b8-4f6e-98af-b5a729e797c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:15.197852 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a442656-d6b8-4f6e-98af-b5a729e797c7 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:15.198130 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a442656-d6b8-4f6e-98af-b5a729e797c7 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:15.198333 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db301a7-eb1b-4347-ad35-6787038c0ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:15.198434 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a442656-d6b8-4f6e-98af-b5a729e797c7 None admin] PATH_INFO: `/v3/projects/fa9501d798e8481da3be76351eec2bf6` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:15.198956 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db301a7-eb1b-4347-ad35-6787038c0ca0 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:15.199234 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db301a7-eb1b-4347-ad35-6787038c0ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:15.199506 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db301a7-eb1b-4347-ad35-6787038c0ca0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:15.199588 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a442656-d6b8-4f6e-98af-b5a729e797c7 None admin] RBAC: Authorizing `identity:get_project(project_id=fa9501d798e8481da3be76351eec2bf6)` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:15.200287 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db301a7-eb1b-4347-ad35-6787038c0ca0 None admin] RBAC: Adding query filter params (group.id=2767cb4da7664937aadecafa78377ea5, role.id=f910595b432f450eb4b382e0c99cf932, scope.project.id=75f1c39fe6504f958e7eea5381109120) {{(pid=87209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:15.200593 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db301a7-eb1b-4347-ad35-6787038c0ca0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:15.200987 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a442656-d6b8-4f6e-98af-b5a729e797c7 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:15.202053 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db301a7-eb1b-4347-ad35-6787038c0ca0 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:15.202692 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 218/452] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Jul 25 21:22:15 2022] GET /identity/v3/projects/fa9501d798e8481da3be76351eec2bf6 => generated 344 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:22:15.208081 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 235/453] 10.222.0.66 () {56 vars in 1376 bytes} [Mon Jul 25 21:22:15 2022] GET /identity/v3/role_assignments?group.id=2767cb4da7664937aadecafa78377ea5&scope.project.id=75f1c39fe6504f958e7eea5381109120&role.id=f910595b432f450eb4b382e0c99cf932 => generated 611 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:15.208400 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a442656-d6b8-4f6e-98af-b5a729e797c7 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:15.317978 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a442656-d6b8-4f6e-98af-b5a729e797c7 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:15.355773 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff1c685-528a-42d3-a550-5c0736dd9f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:15.356434 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff1c685-528a-42d3-a550-5c0736dd9f5c None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:15.356709 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff1c685-528a-42d3-a550-5c0736dd9f5c None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:15.356971 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff1c685-528a-42d3-a550-5c0736dd9f5c None admin] PATH_INFO: `/v3/groups/23070abab6f649c9a657de3e19fa7f27` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:15.358202 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff1c685-528a-42d3-a550-5c0736dd9f5c None admin] RBAC: Authorizing `identity:get_group(group_id=23070abab6f649c9a657de3e19fa7f27)` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:15.359677 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff1c685-528a-42d3-a550-5c0736dd9f5c None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:15.361451 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 219/454] 10.222.0.66 () {56 vars in 1180 bytes} [Mon Jul 25 21:22:15 2022] GET /identity/v3/groups/23070abab6f649c9a657de3e19fa7f27 => generated 229 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:22:15.367850 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db301a7-eb1b-4347-ad35-6787038c0ca0 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:15.457640 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:15.475250 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db301a7-eb1b-4347-ad35-6787038c0ca0 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:15.509149 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba15a261-42a2-40a8-ad67-2746ffa8d218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:15.509784 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba15a261-42a2-40a8-ad67-2746ffa8d218 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:15.510062 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba15a261-42a2-40a8-ad67-2746ffa8d218 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:15.510333 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba15a261-42a2-40a8-ad67-2746ffa8d218 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:15.511118 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba15a261-42a2-40a8-ad67-2746ffa8d218 None admin] RBAC: Adding query filter params (group.id=23070abab6f649c9a657de3e19fa7f27, role.id=216a86497a3a4593ba08730ea8697df3, scope.project.id=fa9501d798e8481da3be76351eec2bf6) {{(pid=87209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:15.511428 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba15a261-42a2-40a8-ad67-2746ffa8d218 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:15.512864 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba15a261-42a2-40a8-ad67-2746ffa8d218 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:15.519227 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 236/455] 10.222.0.66 () {56 vars in 1376 bytes} [Mon Jul 25 21:22:15 2022] GET /identity/v3/role_assignments?group.id=23070abab6f649c9a657de3e19fa7f27&scope.project.id=fa9501d798e8481da3be76351eec2bf6&role.id=216a86497a3a4593ba08730ea8697df3 => generated 611 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:18.132383 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2f7926-94f2-4e5d-9749-7bbcc3189a58 None None] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:18.133449 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2f7926-94f2-4e5d-9749-7bbcc3189a58 None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:18.133930 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2f7926-94f2-4e5d-9749-7bbcc3189a58 None None] PATH_INFO: `/` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:18.135804 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 220/456] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:22:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:22:18.141580 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0245b6de-9fa3-4a4c-9cd6-319c55175b07 None None] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:18.142567 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0245b6de-9fa3-4a4c-9cd6-319c55175b07 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:18.143272 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0245b6de-9fa3-4a4c-9cd6-319c55175b07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:18.163704 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.auth.core [None req-0245b6de-9fa3-4a4c-9cd6-319c55175b07 None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:22:18.165646 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-0245b6de-9fa3-4a4c-9cd6-319c55175b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:22:18.243242 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6946cc-bfae-4476-b234-bae77f85bc9b None None] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:18.243845 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6946cc-bfae-4476-b234-bae77f85bc9b None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:18.244313 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6946cc-bfae-4476-b234-bae77f85bc9b None None] PATH_INFO: `/` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:18.246125 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 221/458] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:22:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 21:22:18.246227 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 237/458] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:22:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:22:18.251664 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fca1bc-7eaf-4159-87fa-a3b58ea01736 None None] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:18.252254 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fca1bc-7eaf-4159-87fa-a3b58ea01736 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:18.252735 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fca1bc-7eaf-4159-87fa-a3b58ea01736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:18.271124 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.auth.core [None req-f9fca1bc-7eaf-4159-87fa-a3b58ea01736 None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:22:18.272171 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6946cc-bfae-4476-b234-bae77f85bc9b None None] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:18.272674 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-f9fca1bc-7eaf-4159-87fa-a3b58ea01736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:22:18.349158 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 238/459] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:22:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:22:18.369381 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:18.370324 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fca1bc-7eaf-4159-87fa-a3b58ea01736 None None] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:18.382397 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:18.400171 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6946cc-bfae-4476-b234-bae77f85bc9b None None] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:18.440669 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e438b0-98b3-491a-ac28-452eb8214521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:18.441350 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e438b0-98b3-491a-ac28-452eb8214521 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:18.441629 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e438b0-98b3-491a-ac28-452eb8214521 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:18.441897 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e438b0-98b3-491a-ac28-452eb8214521 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:18.453431 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e438b0-98b3-491a-ac28-452eb8214521 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:18.454344 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e438b0-98b3-491a-ac28-452eb8214521 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:18.469637 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application [None req-82e438b0-98b3-491a-ac28-452eb8214521 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:22:18.469637 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:22:18.469637 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:22:18.469637 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:22:18.469637 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:22:18.469637 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:22:18.469637 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:22:18.469637 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:22:18.469637 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:22:18.469637 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:22:18.469637 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:22:18.469637 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:22:18.469637 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:22:18.469637 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:22:18.469637 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:22:18.470592 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:22:18.470592 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:22:18.470592 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:22:18.470592 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:22:18.470592 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:22:18.470592 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:22:18.470592 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:22:18.470592 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:22:18.470592 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application with Lock( Jul 25 21:22:18.470592 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:22:18.470592 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:22:18.470592 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:22:18.470592 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:22:18.470592 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:22:18.470592 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:22:18.470592 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:22:18.470592 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:22:18.471436 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:22:18.471436 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:22:18.471436 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:22:18.471436 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Jul 25 21:22:18.471436 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 222/460] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 25 21:22:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 21:22:18.472656 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e8df9b-9614-433d-984f-99864c843056 None None] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:18.472933 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e8df9b-9614-433d-984f-99864c843056 None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:18.473229 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e8df9b-9614-433d-984f-99864c843056 None None] PATH_INFO: `/` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:18.474669 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 223/461] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:22:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:22:18.476916 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e8df9b-9614-433d-984f-99864c843056 None None] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:18.495651 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fca1bc-7eaf-4159-87fa-a3b58ea01736 None None] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:18.535692 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ce8842-497a-4ef7-adf1-5a8cc118dc5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:18.537052 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ce8842-497a-4ef7-adf1-5a8cc118dc5f None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:18.537740 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ce8842-497a-4ef7-adf1-5a8cc118dc5f None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:18.538385 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ce8842-497a-4ef7-adf1-5a8cc118dc5f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:18.553439 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ce8842-497a-4ef7-adf1-5a8cc118dc5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:18.555122 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ce8842-497a-4ef7-adf1-5a8cc118dc5f None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:18.573127 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application [None req-21ce8842-497a-4ef7-adf1-5a8cc118dc5f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:22:18.573127 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:22:18.573127 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:22:18.573127 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:22:18.573127 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:22:18.573127 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:22:18.573127 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:22:18.573127 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:22:18.573127 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:22:18.573127 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:22:18.573127 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:22:18.573127 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:22:18.573127 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:22:18.573127 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:22:18.573127 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:22:18.574037 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:22:18.574037 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:22:18.574037 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:22:18.574037 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:22:18.574037 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:22:18.574037 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:22:18.574037 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:22:18.574037 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:22:18.574037 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application with Lock( Jul 25 21:22:18.574037 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:22:18.574037 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:22:18.574037 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:22:18.574037 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:22:18.574037 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:22:18.574037 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:22:18.574037 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:22:18.574037 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:22:18.574868 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:22:18.574868 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:22:18.574868 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:22:18.574868 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Jul 25 21:22:18.574868 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 239/462] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 25 21:22:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 21:22:18.575899 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b567bd5-2e9e-4117-a961-99a9c94936ba None None] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:18.576182 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b567bd5-2e9e-4117-a961-99a9c94936ba None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:18.576443 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b567bd5-2e9e-4117-a961-99a9c94936ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:18.595776 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.auth.core [None req-8b567bd5-2e9e-4117-a961-99a9c94936ba None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:22:18.597304 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-8b567bd5-2e9e-4117-a961-99a9c94936ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:22:18.599384 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e8df9b-9614-433d-984f-99864c843056 None None] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:18.614982 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:18.638156 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bbd92d-579f-43f3-b691-022f456a7e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:18.638804 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bbd92d-579f-43f3-b691-022f456a7e55 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:18.639360 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bbd92d-579f-43f3-b691-022f456a7e55 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:18.639360 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bbd92d-579f-43f3-b691-022f456a7e55 None admin] PATH_INFO: `/v3/domains` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:18.640046 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bbd92d-579f-43f3-b691-022f456a7e55 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:18.640346 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bbd92d-579f-43f3-b691-022f456a7e55 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:18.641827 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bbd92d-579f-43f3-b691-022f456a7e55 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:18.655090 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 224/463] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Jul 25 21:22:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:22:18.655877 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:18.655996 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bbd92d-579f-43f3-b691-022f456a7e55 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:18.672285 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 240/464] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:22:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:22:18.673598 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916d024c-247a-4eaa-859e-4d706c8d2c3a None None] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:18.674004 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916d024c-247a-4eaa-859e-4d706c8d2c3a None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:18.674277 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916d024c-247a-4eaa-859e-4d706c8d2c3a None None] PATH_INFO: `/` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:18.675521 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 241/465] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:22:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:22:18.676250 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916d024c-247a-4eaa-859e-4d706c8d2c3a None None] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:18.766789 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bbd92d-579f-43f3-b691-022f456a7e55 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:18.781556 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916d024c-247a-4eaa-859e-4d706c8d2c3a None None] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:18.802238 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459c05aa-4241-45d3-9681-587861c8473f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:18.802887 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459c05aa-4241-45d3-9681-587861c8473f None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:18.803160 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459c05aa-4241-45d3-9681-587861c8473f None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:18.803425 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459c05aa-4241-45d3-9681-587861c8473f None admin] PATH_INFO: `/v3/domains` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:18.804103 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459c05aa-4241-45d3-9681-587861c8473f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:18.804396 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459c05aa-4241-45d3-9681-587861c8473f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:18.806051 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459c05aa-4241-45d3-9681-587861c8473f None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:18.816844 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcd7fa6-2049-4f52-80f3-f278eb2dafb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:18.817493 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 225/466] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Jul 25 21:22:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:18.817616 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcd7fa6-2049-4f52-80f3-f278eb2dafb7 None admin] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:18.817790 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcd7fa6-2049-4f52-80f3-f278eb2dafb7 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:18.818050 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcd7fa6-2049-4f52-80f3-f278eb2dafb7 None admin] PATH_INFO: `/v3/users` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:18.818670 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360bd952-e2a2-418a-a765-802ac8de4a3b None None] REQUEST_METHOD: `POST` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:18.818827 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcd7fa6-2049-4f52-80f3-f278eb2dafb7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:18.818974 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360bd952-e2a2-418a-a765-802ac8de4a3b None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:18.819229 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360bd952-e2a2-418a-a765-802ac8de4a3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:18.820243 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcd7fa6-2049-4f52-80f3-f278eb2dafb7 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:18.838191 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.auth.core [None req-360bd952-e2a2-418a-a765-802ac8de4a3b None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:22:18.839400 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.fernet_utils [None req-360bd952-e2a2-418a-a765-802ac8de4a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:22:18.841980 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 242/467] 10.222.0.66 () {60 vars in 1132 bytes} [Mon Jul 25 21:22:18 2022] POST /identity/v3/users => generated 246 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 21:22:18.842797 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcd7fa6-2049-4f52-80f3-f278eb2dafb7 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:18.883657 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:18.903088 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:18.931772 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 226/468] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:22:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:22:18.942196 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360bd952-e2a2-418a-a765-802ac8de4a3b None None] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:18.984675 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcd7fa6-2049-4f52-80f3-f278eb2dafb7 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:19.024424 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dd1dcb-c84a-4c64-8d58-1823095a95e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:19.025004 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dd1dcb-c84a-4c64-8d58-1823095a95e3 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:19.025317 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dd1dcb-c84a-4c64-8d58-1823095a95e3 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:19.025589 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dd1dcb-c84a-4c64-8d58-1823095a95e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:19.037908 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dd1dcb-c84a-4c64-8d58-1823095a95e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:19.039427 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dd1dcb-c84a-4c64-8d58-1823095a95e3 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:19.054581 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application [None req-97dd1dcb-c84a-4c64-8d58-1823095a95e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:22:19.054581 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:22:19.054581 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:22:19.054581 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:22:19.054581 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:22:19.054581 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:22:19.054581 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:22:19.054581 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:22:19.054581 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:22:19.054581 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:22:19.054581 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:22:19.054581 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:22:19.054581 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:22:19.054581 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:22:19.054581 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:22:19.055455 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:22:19.055455 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:22:19.055455 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:22:19.055455 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:22:19.055455 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:22:19.055455 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:22:19.055455 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:22:19.055455 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:22:19.055455 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application with Lock( Jul 25 21:22:19.055455 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:22:19.055455 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:22:19.055455 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:22:19.055455 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:22:19.055455 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:22:19.055455 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:22:19.055455 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:22:19.055455 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:22:19.056324 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:22:19.056324 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:22:19.056324 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:22:19.056324 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Jul 25 21:22:19.056324 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 243/469] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 25 21:22:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:22:19.056586 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dd1dcb-c84a-4c64-8d58-1823095a95e3 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:19.059761 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360bd952-e2a2-418a-a765-802ac8de4a3b None None] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:19.097557 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a37b72-e0c7-4001-8192-a9e39f905052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:19.098300 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a37b72-e0c7-4001-8192-a9e39f905052 None admin] REQUEST_METHOD: `POST` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:19.098631 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a37b72-e0c7-4001-8192-a9e39f905052 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:19.098898 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a37b72-e0c7-4001-8192-a9e39f905052 None admin] PATH_INFO: `/v3/users` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:19.099568 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a37b72-e0c7-4001-8192-a9e39f905052 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:19.101004 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a37b72-e0c7-4001-8192-a9e39f905052 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:19.125288 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 227/470] 10.222.0.66 () {60 vars in 1132 bytes} [Mon Jul 25 21:22:18 2022] POST /identity/v3/users => generated 248 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 21:22:19.126231 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a37b72-e0c7-4001-8192-a9e39f905052 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:19.156310 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:19.193615 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:19.199369 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dd1dcb-c84a-4c64-8d58-1823095a95e3 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:19.241543 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a1bf05-7126-4092-97ac-e0792f359b0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:19.242706 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a1bf05-7126-4092-97ac-e0792f359b0f None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:19.243169 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a1bf05-7126-4092-97ac-e0792f359b0f None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:19.243790 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a1bf05-7126-4092-97ac-e0792f359b0f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:19.257286 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a1bf05-7126-4092-97ac-e0792f359b0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:19.259134 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a1bf05-7126-4092-97ac-e0792f359b0f None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:19.274836 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a37b72-e0c7-4001-8192-a9e39f905052 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:19.277222 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application [None req-e6a1bf05-7126-4092-97ac-e0792f359b0f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:22:19.277222 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:22:19.277222 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:22:19.277222 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:22:19.277222 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:22:19.277222 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:22:19.277222 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:22:19.277222 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:22:19.277222 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:22:19.277222 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:22:19.277222 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:22:19.277222 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:22:19.277222 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:22:19.277222 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:22:19.277222 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:22:19.278063 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:22:19.278063 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:22:19.278063 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:22:19.278063 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:22:19.278063 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:22:19.278063 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:22:19.278063 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:22:19.278063 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:22:19.278063 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application with Lock( Jul 25 21:22:19.278063 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:22:19.278063 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:22:19.278063 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:22:19.278063 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:22:19.278063 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:22:19.278063 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:22:19.278063 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:22:19.278063 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:22:19.278944 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:22:19.278944 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:22:19.278944 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:22:19.278944 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Jul 25 21:22:19.285248 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 244/471] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 25 21:22:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:22:19.288460 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a1bf05-7126-4092-97ac-e0792f359b0f None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:19.320423 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c991da3f-c83e-49f0-8e6c-9815219add51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:19.321068 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c991da3f-c83e-49f0-8e6c-9815219add51 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:19.321376 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c991da3f-c83e-49f0-8e6c-9815219add51 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:19.321651 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c991da3f-c83e-49f0-8e6c-9815219add51 None admin] PATH_INFO: `/v3/domains` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:19.322353 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c991da3f-c83e-49f0-8e6c-9815219add51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:19.322660 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c991da3f-c83e-49f0-8e6c-9815219add51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:19.325254 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c991da3f-c83e-49f0-8e6c-9815219add51 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:19.338914 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 228/472] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Jul 25 21:22:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:19.344302 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c991da3f-c83e-49f0-8e6c-9815219add51 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:19.424185 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a1bf05-7126-4092-97ac-e0792f359b0f None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:19.439793 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:19.461671 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c991da3f-c83e-49f0-8e6c-9815219add51 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:19.465524 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8ccc21-b4ab-4b24-9b84-904e6478619b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:19.466264 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8ccc21-b4ab-4b24-9b84-904e6478619b None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:19.466641 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8ccc21-b4ab-4b24-9b84-904e6478619b None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:19.467033 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8ccc21-b4ab-4b24-9b84-904e6478619b None admin] PATH_INFO: `/v3/domains` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:19.467820 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8ccc21-b4ab-4b24-9b84-904e6478619b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:19.468217 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8ccc21-b4ab-4b24-9b84-904e6478619b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:19.469728 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8ccc21-b4ab-4b24-9b84-904e6478619b None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:19.489128 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 245/473] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Jul 25 21:22:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:22:19.494752 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8ccc21-b4ab-4b24-9b84-904e6478619b None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:19.501321 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9b7efa-ca7f-4206-82a9-4df154e2e951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:19.502073 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9b7efa-ca7f-4206-82a9-4df154e2e951 None admin] REQUEST_METHOD: `POST` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:19.502558 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9b7efa-ca7f-4206-82a9-4df154e2e951 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:19.502835 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9b7efa-ca7f-4206-82a9-4df154e2e951 None admin] PATH_INFO: `/v3/users` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:19.503502 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9b7efa-ca7f-4206-82a9-4df154e2e951 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:19.505684 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9b7efa-ca7f-4206-82a9-4df154e2e951 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:19.522025 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:19.531975 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 229/474] 10.222.0.66 () {60 vars in 1132 bytes} [Mon Jul 25 21:22:19 2022] POST /identity/v3/users => generated 248 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 21:22:19.629355 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8ccc21-b4ab-4b24-9b84-904e6478619b None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:19.669958 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adace8e-eda7-4e18-99a2-2b84876436a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:19.670657 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adace8e-eda7-4e18-99a2-2b84876436a4 None admin] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:19.670938 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adace8e-eda7-4e18-99a2-2b84876436a4 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:19.671211 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adace8e-eda7-4e18-99a2-2b84876436a4 None admin] PATH_INFO: `/v3/users` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:19.671897 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adace8e-eda7-4e18-99a2-2b84876436a4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:19.680393 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adace8e-eda7-4e18-99a2-2b84876436a4 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:19.704742 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 246/475] 10.222.0.66 () {60 vars in 1132 bytes} [Mon Jul 25 21:22:19 2022] POST /identity/v3/users => generated 249 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 21:22:21.220704 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fad29e-2dc7-4b48-81fa-b9c0e4942f78 None None] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:21.221390 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fad29e-2dc7-4b48-81fa-b9c0e4942f78 None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:21.221468 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fad29e-2dc7-4b48-81fa-b9c0e4942f78 None None] PATH_INFO: `/` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:21.223289 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 230/476] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:22:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:22:21.228619 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd93641b-f016-4025-b7bb-6a3862a09587 None None] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:21.229047 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd93641b-f016-4025-b7bb-6a3862a09587 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:21.229176 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd93641b-f016-4025-b7bb-6a3862a09587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:21.247614 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.auth.core [None req-dd93641b-f016-4025-b7bb-6a3862a09587 None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:22:21.248793 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-dd93641b-f016-4025-b7bb-6a3862a09587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:22:21.310916 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:21.319834 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 247/477] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:22:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 21:22:21.344862 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fad29e-2dc7-4b48-81fa-b9c0e4942f78 None None] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:21.463126 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fad29e-2dc7-4b48-81fa-b9c0e4942f78 None None] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:21.499949 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a98d23d-5999-47a2-9c60-36dbce6010a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:21.500957 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a98d23d-5999-47a2-9c60-36dbce6010a3 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:21.501460 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a98d23d-5999-47a2-9c60-36dbce6010a3 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:21.502029 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a98d23d-5999-47a2-9c60-36dbce6010a3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:21.505469 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:21.515383 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a98d23d-5999-47a2-9c60-36dbce6010a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:22:21.521109 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application [None req-6a98d23d-5999-47a2-9c60-36dbce6010a3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 21:22:21.521109 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:22:21.521109 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:22:21.521109 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:22:21.521109 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:22:21.521109 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:22:21.521109 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:22:21.521109 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:22:21.521109 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:22:21.521109 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:22:21.521109 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:22:21.521109 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:22:21.521109 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:22:21.521109 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:22:21.521109 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:22:21.521109 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:22:21.522004 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:22:21.522004 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:22:21.522004 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:22:21.522004 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:22:21.522004 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:22:21.522004 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:22:21.522004 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:22:21.522004 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:22:21.522004 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:22:21.522004 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:22:21.522004 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:22:21.522004 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application with Lock( Jul 25 21:22:21.522004 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:22:21.522004 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:22:21.522004 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:22:21.522004 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:22:21.522810 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:22:21.522810 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:22:21.522810 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:22:21.522810 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:22:21.522810 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:22:21.522810 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:22:21.522810 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:22:21.522810 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:22:21.522810 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:22:21.522810 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:22:21.522810 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 21:22:21.522810 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Jul 25 21:22:21.529234 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 231/478] 10.222.0.66 () {56 vars in 1102 bytes} [Mon Jul 25 21:22:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:22:21.531763 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd93641b-f016-4025-b7bb-6a3862a09587 None None] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:21.554856 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac1f31-5594-4256-ac36-11cb7c70eadd None None] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:21.555161 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac1f31-5594-4256-ac36-11cb7c70eadd None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:21.555405 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac1f31-5594-4256-ac36-11cb7c70eadd None None] PATH_INFO: `/` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:21.557116 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 232/479] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:22:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 21:22:21.562327 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d357a0-e3a3-4f34-a289-c8e64b9622fd None None] REQUEST_METHOD: `POST` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:21.562614 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d357a0-e3a3-4f34-a289-c8e64b9622fd None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:21.562884 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d357a0-e3a3-4f34-a289-c8e64b9622fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:21.582401 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.auth.core [None req-a3d357a0-e3a3-4f34-a289-c8e64b9622fd None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:22:21.583625 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.fernet_utils [None req-a3d357a0-e3a3-4f34-a289-c8e64b9622fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:22:21.642908 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd93641b-f016-4025-b7bb-6a3862a09587 None None] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:21.665229 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 233/480] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:22:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 21:22:21.680791 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79dd8cc-acbc-4ca5-98b1-c79fbb3a68a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:21.681871 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79dd8cc-acbc-4ca5-98b1-c79fbb3a68a4 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:21.682209 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79dd8cc-acbc-4ca5-98b1-c79fbb3a68a4 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:21.682542 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79dd8cc-acbc-4ca5-98b1-c79fbb3a68a4 None admin] PATH_INFO: `/v3/roles` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:21.683316 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79dd8cc-acbc-4ca5-98b1-c79fbb3a68a4 None admin] RBAC: Adding query filter params (name=service) {{(pid=87209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:21.683658 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d357a0-e3a3-4f34-a289-c8e64b9622fd None None] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:21.683764 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79dd8cc-acbc-4ca5-98b1-c79fbb3a68a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:21.685159 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79dd8cc-acbc-4ca5-98b1-c79fbb3a68a4 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:21.703144 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 248/481] 10.222.0.66 () {56 vars in 1103 bytes} [Mon Jul 25 21:22:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:21.704742 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79dd8cc-acbc-4ca5-98b1-c79fbb3a68a4 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:21.791886 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:21.800591 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d357a0-e3a3-4f34-a289-c8e64b9622fd None None] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:21.827836 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:21.839717 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa132184-7aef-43e3-afbc-c7fdeb1bb247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:21.840918 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa132184-7aef-43e3-afbc-c7fdeb1bb247 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:21.841296 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa132184-7aef-43e3-afbc-c7fdeb1bb247 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:21.841656 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa132184-7aef-43e3-afbc-c7fdeb1bb247 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:21.855824 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79dd8cc-acbc-4ca5-98b1-c79fbb3a68a4 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:21.858699 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa132184-7aef-43e3-afbc-c7fdeb1bb247 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:22:21.865503 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application [None req-fa132184-7aef-43e3-afbc-c7fdeb1bb247 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 21:22:21.865503 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:22:21.865503 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:22:21.865503 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:22:21.865503 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:22:21.865503 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:22:21.865503 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:22:21.865503 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:22:21.865503 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:22:21.865503 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:22:21.865503 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:22:21.865503 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:22:21.865503 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:22:21.865503 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:22:21.865503 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:22:21.865503 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:22:21.866514 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:22:21.866514 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:22:21.866514 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:22:21.866514 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:22:21.866514 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:22:21.866514 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:22:21.866514 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:22:21.866514 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:22:21.866514 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:22:21.866514 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:22:21.866514 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:22:21.866514 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application with Lock( Jul 25 21:22:21.866514 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:22:21.866514 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:22:21.866514 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:22:21.866514 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:22:21.867329 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:22:21.867329 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:22:21.867329 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:22:21.867329 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:22:21.867329 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:22:21.867329 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:22:21.867329 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:22:21.867329 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:22:21.867329 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:22:21.867329 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:22:21.867329 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 21:22:21.867329 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Jul 25 21:22:21.869154 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 234/482] 10.222.0.66 () {56 vars in 1102 bytes} [Mon Jul 25 21:22:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:22:21.872480 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa132184-7aef-43e3-afbc-c7fdeb1bb247 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:21.900989 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6638db8d-bd7e-4ce2-af6f-5afe960bcbfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:21.902285 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6638db8d-bd7e-4ce2-af6f-5afe960bcbfe None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:21.902867 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6638db8d-bd7e-4ce2-af6f-5afe960bcbfe None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:21.903410 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6638db8d-bd7e-4ce2-af6f-5afe960bcbfe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:21.921462 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6638db8d-bd7e-4ce2-af6f-5afe960bcbfe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:21.922970 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6638db8d-bd7e-4ce2-af6f-5afe960bcbfe None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:21.938913 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application [None req-6638db8d-bd7e-4ce2-af6f-5afe960bcbfe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:22:21.938913 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:22:21.938913 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:22:21.938913 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:22:21.938913 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:22:21.938913 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:22:21.938913 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:22:21.938913 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:22:21.938913 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:22:21.938913 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:22:21.938913 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:22:21.938913 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:22:21.938913 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:22:21.938913 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:22:21.938913 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:22:21.940395 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:22:21.940395 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:22:21.940395 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:22:21.940395 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:22:21.940395 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:22:21.940395 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:22:21.940395 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:22:21.940395 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:22:21.940395 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application with Lock( Jul 25 21:22:21.940395 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:22:21.940395 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:22:21.940395 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:22:21.940395 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:22:21.940395 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:22:21.940395 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:22:21.940395 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:22:21.940395 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:22:21.941701 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:22:21.941701 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:22:21.941701 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:22:21.941701 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Jul 25 21:22:21.941701 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 249/483] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 25 21:22:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 21:22:21.941988 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a711bc95-6810-4151-b98d-d662bfc44b2b None None] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:21.942267 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a711bc95-6810-4151-b98d-d662bfc44b2b None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:21.942534 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a711bc95-6810-4151-b98d-d662bfc44b2b None None] PATH_INFO: `/` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:21.943912 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 250/484] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:22:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:22:21.948382 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a711bc95-6810-4151-b98d-d662bfc44b2b None None] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:22.009146 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa132184-7aef-43e3-afbc-c7fdeb1bb247 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:22.047387 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5233f4-387c-4668-82a7-7a06da0e9da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:22.047934 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5233f4-387c-4668-82a7-7a06da0e9da9 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:22.048213 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5233f4-387c-4668-82a7-7a06da0e9da9 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:22.048482 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5233f4-387c-4668-82a7-7a06da0e9da9 None admin] PATH_INFO: `/v3/roles` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:22.049493 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5233f4-387c-4668-82a7-7a06da0e9da9 None admin] RBAC: Adding query filter params (name=service) {{(pid=87210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:22.049767 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5233f4-387c-4668-82a7-7a06da0e9da9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:22.051313 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5233f4-387c-4668-82a7-7a06da0e9da9 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:22.059619 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a711bc95-6810-4151-b98d-d662bfc44b2b None None] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:22.064787 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 235/485] 10.222.0.66 () {56 vars in 1103 bytes} [Mon Jul 25 21:22:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:22:22.064787 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07ec8b8-2377-465a-bc0e-fdc09b72a758 None None] REQUEST_METHOD: `POST` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:22.064787 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07ec8b8-2377-465a-bc0e-fdc09b72a758 None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:22.064787 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07ec8b8-2377-465a-bc0e-fdc09b72a758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:22.075120 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:22.081201 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.auth.core [None req-b07ec8b8-2377-465a-bc0e-fdc09b72a758 None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:22:22.082512 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.fernet_utils [None req-b07ec8b8-2377-465a-bc0e-fdc09b72a758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:22:22.099400 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05027daf-10a9-42ab-bee1-c643ed398af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:22.100024 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05027daf-10a9-42ab-bee1-c643ed398af2 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:22.100306 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05027daf-10a9-42ab-bee1-c643ed398af2 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:22.100576 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05027daf-10a9-42ab-bee1-c643ed398af2 None admin] PATH_INFO: `/v3/domains` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:22.101285 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05027daf-10a9-42ab-bee1-c643ed398af2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:22.101588 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05027daf-10a9-42ab-bee1-c643ed398af2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:22.103340 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05027daf-10a9-42ab-bee1-c643ed398af2 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:22.114938 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 251/486] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Jul 25 21:22:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:22:22.115741 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05027daf-10a9-42ab-bee1-c643ed398af2 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:22.129963 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:22.153886 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 236/487] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:22:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:22:22.155227 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72647a2e-5373-42a3-a408-099db5df2a2b None None] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:22.155514 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72647a2e-5373-42a3-a408-099db5df2a2b None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:22.155785 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72647a2e-5373-42a3-a408-099db5df2a2b None None] PATH_INFO: `/` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:22.157043 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 237/488] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:22:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:22:22.157795 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72647a2e-5373-42a3-a408-099db5df2a2b None None] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:22.225328 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05027daf-10a9-42ab-bee1-c643ed398af2 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:22.262088 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5041bb-c839-4e51-88e4-de90099d6339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:22.263470 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5041bb-c839-4e51-88e4-de90099d6339 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:22.263738 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5041bb-c839-4e51-88e4-de90099d6339 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:22.264034 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5041bb-c839-4e51-88e4-de90099d6339 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:22.266661 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72647a2e-5373-42a3-a408-099db5df2a2b None None] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:22.274534 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5041bb-c839-4e51-88e4-de90099d6339 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:22.276018 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5041bb-c839-4e51-88e4-de90099d6339 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:22.291267 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application [None req-3e5041bb-c839-4e51-88e4-de90099d6339 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:22:22.291267 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:22:22.291267 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:22:22.291267 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:22:22.291267 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:22:22.291267 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:22:22.291267 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:22:22.291267 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:22:22.291267 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:22:22.291267 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:22:22.291267 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:22:22.291267 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:22:22.291267 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:22:22.291267 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:22:22.291267 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:22:22.292148 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:22:22.292148 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:22:22.292148 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:22:22.292148 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:22:22.292148 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:22:22.292148 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:22:22.292148 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:22:22.292148 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:22:22.292148 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application with Lock( Jul 25 21:22:22.292148 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:22:22.292148 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:22:22.292148 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:22:22.292148 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:22:22.292148 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:22:22.292148 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:22:22.292148 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:22:22.292148 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:22:22.292994 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:22:22.292994 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:22:22.292994 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:22:22.292994 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Jul 25 21:22:22.292994 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 252/489] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 25 21:22:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:22:22.293725 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3097faf6-b1d0-48c8-ab1e-5365c3175063 None None] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:22.294019 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3097faf6-b1d0-48c8-ab1e-5365c3175063 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:22.294288 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3097faf6-b1d0-48c8-ab1e-5365c3175063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:22.304354 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a34690e-c9f7-45bf-a001-ff7aa5f2e9f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:22.304933 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a34690e-c9f7-45bf-a001-ff7aa5f2e9f2 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:22.305252 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a34690e-c9f7-45bf-a001-ff7aa5f2e9f2 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:22.305527 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a34690e-c9f7-45bf-a001-ff7aa5f2e9f2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:22.312167 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.auth.core [None req-3097faf6-b1d0-48c8-ab1e-5365c3175063 None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:22:22.313373 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-3097faf6-b1d0-48c8-ab1e-5365c3175063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:22:22.313478 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a34690e-c9f7-45bf-a001-ff7aa5f2e9f2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:22.315115 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a34690e-c9f7-45bf-a001-ff7aa5f2e9f2 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:22.328668 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application [None req-8a34690e-c9f7-45bf-a001-ff7aa5f2e9f2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 21:22:22.328668 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:22:22.328668 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:22:22.328668 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:22:22.328668 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:22:22.328668 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:22:22.328668 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:22:22.328668 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:22:22.328668 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:22:22.328668 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:22:22.328668 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:22:22.328668 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:22:22.328668 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 21:22:22.328668 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 21:22:22.328668 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 21:22:22.328668 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 21:22:22.329725 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:22:22.329725 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:22:22.329725 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 21:22:22.329725 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:22:22.329725 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 21:22:22.329725 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:22:22.329725 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:22:22.329725 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:22:22.329725 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:22:22.329725 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:22:22.329725 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:22:22.329725 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application with Lock( Jul 25 21:22:22.329725 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:22:22.329725 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:22:22.329725 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:22:22.329725 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:22:22.329725 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:22:22.329725 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:22:22.330672 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:22:22.330672 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:22:22.330672 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 21:22:22.330672 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 21:22:22.330672 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 21:22:22.330672 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 21:22:22.330672 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 21:22:22.330672 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 21:22:22.330672 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 21:22:22.330672 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Jul 25 21:22:22.330672 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 238/490] 10.222.0.66 () {56 vars in 1093 bytes} [Mon Jul 25 21:22:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:22:22.331478 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a34690e-c9f7-45bf-a001-ff7aa5f2e9f2 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:22.332321 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:22.373935 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:22.386483 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 253/491] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:22:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:22:22.387324 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3097faf6-b1d0-48c8-ab1e-5365c3175063 None None] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:22.442512 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a34690e-c9f7-45bf-a001-ff7aa5f2e9f2 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:22.478931 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9dd2c5-7171-40ed-ac1e-f3033d806bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:22.479572 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9dd2c5-7171-40ed-ac1e-f3033d806bdb None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:22.479855 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9dd2c5-7171-40ed-ac1e-f3033d806bdb None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:22.480128 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9dd2c5-7171-40ed-ac1e-f3033d806bdb None admin] PATH_INFO: `/v3/roles/service` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:22.491269 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9dd2c5-7171-40ed-ac1e-f3033d806bdb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:22:22.495459 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3097faf6-b1d0-48c8-ab1e-5365c3175063 None None] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:22.496825 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application [None req-0d9dd2c5-7171-40ed-ac1e-f3033d806bdb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 21:22:22.496825 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:22:22.496825 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:22:22.496825 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:22:22.496825 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:22:22.496825 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:22:22.496825 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:22:22.496825 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:22:22.496825 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:22:22.496825 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:22:22.496825 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:22:22.496825 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:22:22.496825 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:22:22.496825 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:22:22.496825 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:22:22.496825 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:22:22.498028 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:22:22.498028 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:22:22.498028 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:22:22.498028 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:22:22.498028 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:22:22.498028 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:22:22.498028 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:22:22.498028 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:22:22.498028 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:22:22.498028 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:22:22.498028 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:22:22.498028 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application with Lock( Jul 25 21:22:22.498028 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:22:22.498028 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:22:22.498028 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:22:22.498028 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:22:22.498861 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:22:22.498861 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:22:22.498861 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:22:22.498861 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:22:22.498861 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:22:22.498861 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:22:22.498861 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:22:22.498861 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:22:22.498861 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:22:22.498861 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:22:22.498861 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 21:22:22.498861 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Jul 25 21:22:22.498861 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 239/492] 10.222.0.66 () {56 vars in 1102 bytes} [Mon Jul 25 21:22:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:22:22.498861 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9dd2c5-7171-40ed-ac1e-f3033d806bdb None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:22.537409 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4cf401-6bee-4aa5-9371-7bf66cfd7cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:22.538030 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4cf401-6bee-4aa5-9371-7bf66cfd7cfd None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:22.538310 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4cf401-6bee-4aa5-9371-7bf66cfd7cfd None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:22.538574 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4cf401-6bee-4aa5-9371-7bf66cfd7cfd None admin] PATH_INFO: `/v3/domains` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:22.539248 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4cf401-6bee-4aa5-9371-7bf66cfd7cfd None admin] RBAC: Adding query filter params (name=Default) {{(pid=87209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:22.539539 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4cf401-6bee-4aa5-9371-7bf66cfd7cfd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:22.541316 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4cf401-6bee-4aa5-9371-7bf66cfd7cfd None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:22.553265 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 254/493] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Jul 25 21:22:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:22.554072 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4cf401-6bee-4aa5-9371-7bf66cfd7cfd None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:22.568825 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:22.596423 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:22.600632 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9dd2c5-7171-40ed-ac1e-f3033d806bdb None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:22.635195 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f3636a-8d12-474a-9d6d-1463e4d06d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:22.635823 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f3636a-8d12-474a-9d6d-1463e4d06d58 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:22.636106 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f3636a-8d12-474a-9d6d-1463e4d06d58 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:22.636380 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f3636a-8d12-474a-9d6d-1463e4d06d58 None admin] PATH_INFO: `/v3/users` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:22.637210 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f3636a-8d12-474a-9d6d-1463e4d06d58 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:22.637520 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f3636a-8d12-474a-9d6d-1463e4d06d58 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:22.638981 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f3636a-8d12-474a-9d6d-1463e4d06d58 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:22.653007 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4cf401-6bee-4aa5-9371-7bf66cfd7cfd None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:22.676784 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 240/494] 10.222.0.66 () {56 vars in 1133 bytes} [Mon Jul 25 21:22:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:22.677553 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f3636a-8d12-474a-9d6d-1463e4d06d58 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:22.688917 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dcdef7-3981-41a3-b398-17537019cc88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:22.689692 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dcdef7-3981-41a3-b398-17537019cc88 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:22.689972 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dcdef7-3981-41a3-b398-17537019cc88 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:22.690242 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dcdef7-3981-41a3-b398-17537019cc88 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:22.700688 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dcdef7-3981-41a3-b398-17537019cc88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:22:22.706009 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application [None req-51dcdef7-3981-41a3-b398-17537019cc88 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 21:22:22.706009 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:22:22.706009 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:22:22.706009 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:22:22.706009 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:22:22.706009 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:22:22.706009 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:22:22.706009 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:22:22.706009 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:22:22.706009 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:22:22.706009 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:22:22.706009 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:22:22.706009 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:22:22.706009 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:22:22.706009 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:22:22.706009 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:22:22.707410 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:22:22.707410 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:22:22.707410 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:22:22.707410 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:22:22.707410 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:22:22.707410 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:22:22.707410 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:22:22.707410 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:22:22.707410 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:22:22.707410 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:22:22.707410 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:22:22.707410 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application with Lock( Jul 25 21:22:22.707410 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:22:22.707410 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:22:22.707410 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:22:22.707410 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:22:22.708231 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:22:22.708231 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:22:22.708231 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:22:22.708231 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:22:22.708231 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:22:22.708231 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:22:22.708231 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:22:22.708231 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:22:22.708231 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:22:22.708231 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:22:22.708231 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 21:22:22.708231 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Jul 25 21:22:22.708231 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 255/495] 10.222.0.66 () {56 vars in 1102 bytes} [Mon Jul 25 21:22:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:22:22.708231 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dcdef7-3981-41a3-b398-17537019cc88 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:22.778661 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:22.786816 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f3636a-8d12-474a-9d6d-1463e4d06d58 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:22.809919 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dcdef7-3981-41a3-b398-17537019cc88 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:22.823500 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82698b4-4a81-48c1-92e3-5d85f2d78c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:22.824088 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82698b4-4a81-48c1-92e3-5d85f2d78c8e None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:22.824364 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82698b4-4a81-48c1-92e3-5d85f2d78c8e None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:22.824634 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82698b4-4a81-48c1-92e3-5d85f2d78c8e None admin] PATH_INFO: `/v3/roles` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:22.825385 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82698b4-4a81-48c1-92e3-5d85f2d78c8e None admin] RBAC: Adding query filter params (name=service) {{(pid=87210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:22.825683 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82698b4-4a81-48c1-92e3-5d85f2d78c8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:22.827096 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82698b4-4a81-48c1-92e3-5d85f2d78c8e None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:22.835511 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 241/496] 10.222.0.66 () {56 vars in 1103 bytes} [Mon Jul 25 21:22:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:22.836296 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82698b4-4a81-48c1-92e3-5d85f2d78c8e None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:22.843789 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f391f53e-3af5-4b23-a1fa-5af1a9349b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:22.844448 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f391f53e-3af5-4b23-a1fa-5af1a9349b33 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:22.844916 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f391f53e-3af5-4b23-a1fa-5af1a9349b33 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:22.845222 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f391f53e-3af5-4b23-a1fa-5af1a9349b33 None admin] PATH_INFO: `/v3/users/glance` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:22.853733 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f391f53e-3af5-4b23-a1fa-5af1a9349b33 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:22.855221 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f391f53e-3af5-4b23-a1fa-5af1a9349b33 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:22.861441 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:22.868444 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application [None req-f391f53e-3af5-4b23-a1fa-5af1a9349b33 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 25 21:22:22.868444 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:22:22.868444 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:22:22.868444 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:22:22.868444 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:22:22.868444 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:22:22.868444 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:22:22.868444 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:22:22.868444 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:22:22.868444 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:22:22.868444 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:22:22.868444 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:22:22.868444 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 21:22:22.868444 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 21:22:22.868444 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 21:22:22.868444 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 21:22:22.869429 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:22:22.869429 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:22:22.869429 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 21:22:22.869429 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:22:22.869429 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 21:22:22.869429 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:22:22.869429 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:22:22.869429 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:22:22.869429 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:22:22.869429 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:22:22.869429 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:22:22.869429 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application with Lock( Jul 25 21:22:22.869429 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:22:22.869429 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:22:22.869429 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:22:22.869429 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:22:22.869429 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:22:22.869429 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:22:22.870326 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:22:22.870326 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:22:22.870326 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 21:22:22.870326 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 21:22:22.870326 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 21:22:22.870326 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 21:22:22.870326 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 21:22:22.870326 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 21:22:22.870326 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 25 21:22:22.870326 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Jul 25 21:22:22.870326 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 256/497] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Jul 25 21:22:22 2022] GET /identity/v3/users/glance => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:22:22.870897 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f391f53e-3af5-4b23-a1fa-5af1a9349b33 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:22.949218 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82698b4-4a81-48c1-92e3-5d85f2d78c8e None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:22.972006 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f391f53e-3af5-4b23-a1fa-5af1a9349b33 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:22.987093 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc7eec9-2aa3-429c-b592-23b5ff619de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:22.987737 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc7eec9-2aa3-429c-b592-23b5ff619de9 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:22.988017 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc7eec9-2aa3-429c-b592-23b5ff619de9 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:22.988287 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc7eec9-2aa3-429c-b592-23b5ff619de9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:23.001182 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:23.006818 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe44617-4bd4-47eb-8b1e-21d3e46df90a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:23.007444 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe44617-4bd4-47eb-8b1e-21d3e46df90a None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:23.007727 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe44617-4bd4-47eb-8b1e-21d3e46df90a None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:23.007988 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe44617-4bd4-47eb-8b1e-21d3e46df90a None admin] PATH_INFO: `/v3/roles` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:23.008698 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe44617-4bd4-47eb-8b1e-21d3e46df90a None admin] RBAC: Adding query filter params (name=service) {{(pid=87209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:23.008997 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe44617-4bd4-47eb-8b1e-21d3e46df90a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:23.010448 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe44617-4bd4-47eb-8b1e-21d3e46df90a None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:23.021790 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 257/498] 10.222.0.66 () {56 vars in 1103 bytes} [Mon Jul 25 21:22:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:23.021790 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe44617-4bd4-47eb-8b1e-21d3e46df90a None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:23.058619 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc7eec9-2aa3-429c-b592-23b5ff619de9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:23.060065 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc7eec9-2aa3-429c-b592-23b5ff619de9 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:23.077225 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:23.123636 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe44617-4bd4-47eb-8b1e-21d3e46df90a None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:23.157293 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 242/499] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Jul 25 21:22:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 21:22:23.158193 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc7eec9-2aa3-429c-b592-23b5ff619de9 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:23.163440 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93828f3c-a9b6-466f-92c3-d591b2f24206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:23.164101 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93828f3c-a9b6-466f-92c3-d591b2f24206 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:23.164381 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93828f3c-a9b6-466f-92c3-d591b2f24206 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:23.164655 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93828f3c-a9b6-466f-92c3-d591b2f24206 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:23.178228 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93828f3c-a9b6-466f-92c3-d591b2f24206 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:23.180125 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93828f3c-a9b6-466f-92c3-d591b2f24206 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:23.194668 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application [None req-93828f3c-a9b6-466f-92c3-d591b2f24206 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:22:23.194668 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:22:23.194668 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:22:23.194668 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:22:23.194668 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:22:23.194668 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:22:23.194668 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:22:23.194668 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:22:23.194668 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:22:23.194668 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:22:23.194668 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:22:23.194668 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:22:23.194668 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:22:23.194668 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:22:23.194668 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:22:23.195523 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:22:23.195523 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:22:23.195523 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:22:23.195523 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:22:23.195523 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:22:23.195523 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:22:23.195523 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:22:23.195523 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:22:23.195523 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application with Lock( Jul 25 21:22:23.195523 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:22:23.195523 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:22:23.195523 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:22:23.195523 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:22:23.195523 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:22:23.195523 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:22:23.195523 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:22:23.195523 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:22:23.196389 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:22:23.196389 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:22:23.196389 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:22:23.196389 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Jul 25 21:22:23.196389 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 258/500] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 25 21:22:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:22:23.196645 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93828f3c-a9b6-466f-92c3-d591b2f24206 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:23.243237 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:23.262043 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc7eec9-2aa3-429c-b592-23b5ff619de9 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:23.279324 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:23.301353 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93828f3c-a9b6-466f-92c3-d591b2f24206 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:23.302321 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e710f3b9-5ae7-4cbe-a266-d7123fea8035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:23.302951 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e710f3b9-5ae7-4cbe-a266-d7123fea8035 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:23.303228 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e710f3b9-5ae7-4cbe-a266-d7123fea8035 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:23.303499 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e710f3b9-5ae7-4cbe-a266-d7123fea8035 None admin] PATH_INFO: `/v3/users` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:23.304282 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e710f3b9-5ae7-4cbe-a266-d7123fea8035 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:23.304587 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e710f3b9-5ae7-4cbe-a266-d7123fea8035 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:23.306087 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e710f3b9-5ae7-4cbe-a266-d7123fea8035 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:23.323833 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 243/501] 10.222.0.66 () {56 vars in 1137 bytes} [Mon Jul 25 21:22:23 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:23.324730 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e710f3b9-5ae7-4cbe-a266-d7123fea8035 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:23.340817 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34493a1-3439-498d-be3c-37c8aa8e35d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:23.341442 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34493a1-3439-498d-be3c-37c8aa8e35d4 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:23.341710 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34493a1-3439-498d-be3c-37c8aa8e35d4 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:23.342040 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34493a1-3439-498d-be3c-37c8aa8e35d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:23.353153 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34493a1-3439-498d-be3c-37c8aa8e35d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:23.354637 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34493a1-3439-498d-be3c-37c8aa8e35d4 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:23.369581 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application [None req-b34493a1-3439-498d-be3c-37c8aa8e35d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:22:23.369581 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:22:23.369581 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:22:23.369581 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:22:23.369581 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:22:23.369581 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:22:23.369581 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:22:23.369581 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:22:23.369581 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:22:23.369581 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:22:23.369581 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:22:23.369581 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:22:23.369581 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:22:23.369581 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:22:23.369581 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:22:23.370468 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:22:23.370468 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:22:23.370468 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:22:23.370468 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:22:23.370468 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:22:23.370468 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:22:23.370468 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:22:23.370468 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:22:23.370468 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application with Lock( Jul 25 21:22:23.370468 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:22:23.370468 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:22:23.370468 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:22:23.370468 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:22:23.370468 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:22:23.370468 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:22:23.370468 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:22:23.370468 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:22:23.371306 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:22:23.371306 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:22:23.371306 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:22:23.371306 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Jul 25 21:22:23.371306 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 259/502] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 25 21:22:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:22:23.371576 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34493a1-3439-498d-be3c-37c8aa8e35d4 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:23.428642 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e710f3b9-5ae7-4cbe-a266-d7123fea8035 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:23.463007 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5e27a7-6d63-47dd-b25c-01b3e3148581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:23.463650 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5e27a7-6d63-47dd-b25c-01b3e3148581 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:23.463927 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5e27a7-6d63-47dd-b25c-01b3e3148581 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:23.464195 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5e27a7-6d63-47dd-b25c-01b3e3148581 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:23.468319 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:23.472436 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34493a1-3439-498d-be3c-37c8aa8e35d4 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:23.474690 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5e27a7-6d63-47dd-b25c-01b3e3148581 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:23.476179 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5e27a7-6d63-47dd-b25c-01b3e3148581 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:23.490926 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application [None req-2e5e27a7-6d63-47dd-b25c-01b3e3148581 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:22:23.490926 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:22:23.490926 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:22:23.490926 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:22:23.490926 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:22:23.490926 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:22:23.490926 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:22:23.490926 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:22:23.490926 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:22:23.490926 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:22:23.490926 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:22:23.490926 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:22:23.490926 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:22:23.490926 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:22:23.490926 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:22:23.491892 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:22:23.491892 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:22:23.491892 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:22:23.491892 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:22:23.491892 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:22:23.491892 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:22:23.491892 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:22:23.491892 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:22:23.491892 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application with Lock( Jul 25 21:22:23.491892 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:22:23.491892 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:22:23.491892 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:22:23.491892 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:22:23.491892 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:22:23.491892 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:22:23.491892 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:22:23.491892 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:22:23.492731 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:22:23.492731 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:22:23.492731 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:22:23.492731 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Jul 25 21:22:23.492731 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 244/503] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 25 21:22:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:22:23.493010 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5e27a7-6d63-47dd-b25c-01b3e3148581 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:23.507932 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26d10af-f6c5-4176-8971-66d9361d7034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:23.508564 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26d10af-f6c5-4176-8971-66d9361d7034 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:23.508844 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26d10af-f6c5-4176-8971-66d9361d7034 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:23.509147 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26d10af-f6c5-4176-8971-66d9361d7034 None admin] PATH_INFO: `/v3/domains` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:23.509835 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26d10af-f6c5-4176-8971-66d9361d7034 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:23.510136 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26d10af-f6c5-4176-8971-66d9361d7034 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:23.511528 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26d10af-f6c5-4176-8971-66d9361d7034 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:23.522385 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:23.523069 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 260/504] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Jul 25 21:22:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:23.523855 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26d10af-f6c5-4176-8971-66d9361d7034 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:23.598841 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5e27a7-6d63-47dd-b25c-01b3e3148581 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:23.628316 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26d10af-f6c5-4176-8971-66d9361d7034 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:23.632768 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e24a89-2648-4662-9c36-7d94a9e79fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:23.633441 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e24a89-2648-4662-9c36-7d94a9e79fcb None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:23.633716 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e24a89-2648-4662-9c36-7d94a9e79fcb None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:23.633988 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e24a89-2648-4662-9c36-7d94a9e79fcb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:23.662461 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38053d1-74a1-4322-a9d5-c047cf21beab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:23.663086 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38053d1-74a1-4322-a9d5-c047cf21beab None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:23.663363 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38053d1-74a1-4322-a9d5-c047cf21beab None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:23.663638 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38053d1-74a1-4322-a9d5-c047cf21beab None admin] PATH_INFO: `/v3/domains` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:23.664322 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38053d1-74a1-4322-a9d5-c047cf21beab None admin] RBAC: Adding query filter params (name=Default) {{(pid=87209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:23.664633 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38053d1-74a1-4322-a9d5-c047cf21beab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:23.666394 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38053d1-74a1-4322-a9d5-c047cf21beab None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:23.677793 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 261/505] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Jul 25 21:22:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:23.678765 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38053d1-74a1-4322-a9d5-c047cf21beab None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:23.698780 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:23.701473 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e24a89-2648-4662-9c36-7d94a9e79fcb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:23.702941 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e24a89-2648-4662-9c36-7d94a9e79fcb None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:23.732384 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:23.780630 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38053d1-74a1-4322-a9d5-c047cf21beab None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:23.807336 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 245/506] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Jul 25 21:22:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 21:22:23.808161 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e24a89-2648-4662-9c36-7d94a9e79fcb None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:23.818584 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bab688-61b8-43cc-8b4b-5d702c3d2652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:23.819215 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bab688-61b8-43cc-8b4b-5d702c3d2652 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:23.819497 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bab688-61b8-43cc-8b4b-5d702c3d2652 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:23.819770 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bab688-61b8-43cc-8b4b-5d702c3d2652 None admin] PATH_INFO: `/v3/domains` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:23.820460 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bab688-61b8-43cc-8b4b-5d702c3d2652 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:23.820758 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bab688-61b8-43cc-8b4b-5d702c3d2652 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:23.822199 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bab688-61b8-43cc-8b4b-5d702c3d2652 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:23.840004 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 262/507] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Jul 25 21:22:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:23.840004 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bab688-61b8-43cc-8b4b-5d702c3d2652 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:23.907321 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e24a89-2648-4662-9c36-7d94a9e79fcb None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:23.916812 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:23.937717 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:23.948573 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bab688-61b8-43cc-8b4b-5d702c3d2652 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:23.950282 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fac5d56-08ae-4ae7-a5e2-e532a7a560ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:23.950944 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fac5d56-08ae-4ae7-a5e2-e532a7a560ef None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:23.951218 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fac5d56-08ae-4ae7-a5e2-e532a7a560ef None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:23.951490 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fac5d56-08ae-4ae7-a5e2-e532a7a560ef None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:23.959856 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fac5d56-08ae-4ae7-a5e2-e532a7a560ef None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:23.961635 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fac5d56-08ae-4ae7-a5e2-e532a7a560ef None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:23.973857 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application [None req-2fac5d56-08ae-4ae7-a5e2-e532a7a560ef None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 21:22:23.973857 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:22:23.973857 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:22:23.973857 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:22:23.973857 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:22:23.973857 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:22:23.973857 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:22:23.973857 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:22:23.973857 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:22:23.973857 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:22:23.973857 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:22:23.973857 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:22:23.973857 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 21:22:23.973857 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 21:22:23.973857 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 21:22:23.973857 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 21:22:23.974804 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:22:23.974804 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:22:23.974804 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 21:22:23.974804 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:22:23.974804 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 21:22:23.974804 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:22:23.974804 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:22:23.974804 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:22:23.974804 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:22:23.974804 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:22:23.974804 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:22:23.974804 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application with Lock( Jul 25 21:22:23.974804 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:22:23.974804 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:22:23.974804 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:22:23.974804 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:22:23.974804 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:22:23.974804 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:22:23.976161 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:22:23.976161 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:22:23.976161 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 21:22:23.976161 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 21:22:23.976161 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 21:22:23.976161 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 21:22:23.976161 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 21:22:23.976161 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 21:22:23.976161 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 21:22:23.976161 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Jul 25 21:22:23.976161 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 246/508] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Jul 25 21:22:23 2022] GET /identity/v3/users/cinder => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:22:23.976161 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fac5d56-08ae-4ae7-a5e2-e532a7a560ef None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:23.988513 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7053eee0-de69-421f-847d-d1b86e447f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:23.989207 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7053eee0-de69-421f-847d-d1b86e447f11 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:23.989483 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7053eee0-de69-421f-847d-d1b86e447f11 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:23.989749 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7053eee0-de69-421f-847d-d1b86e447f11 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:23.996953 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7053eee0-de69-421f-847d-d1b86e447f11 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:23.998449 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7053eee0-de69-421f-847d-d1b86e447f11 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:24.010180 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application [None req-7053eee0-de69-421f-847d-d1b86e447f11 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 25 21:22:24.010180 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:22:24.010180 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:22:24.010180 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:22:24.010180 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:22:24.010180 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:22:24.010180 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:22:24.010180 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:22:24.010180 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:22:24.010180 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:22:24.010180 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:22:24.010180 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:22:24.010180 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 21:22:24.010180 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 21:22:24.010180 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 21:22:24.010180 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 21:22:24.011278 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:22:24.011278 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:22:24.011278 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 21:22:24.011278 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:22:24.011278 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 21:22:24.011278 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:22:24.011278 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:22:24.011278 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:22:24.011278 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:22:24.011278 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:22:24.011278 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:22:24.011278 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application with Lock( Jul 25 21:22:24.011278 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:22:24.011278 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:22:24.011278 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:22:24.011278 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:22:24.011278 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:22:24.011278 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:22:24.012231 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:22:24.012231 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:22:24.012231 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 21:22:24.012231 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 21:22:24.012231 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 21:22:24.012231 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 21:22:24.012231 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 21:22:24.012231 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 21:22:24.012231 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 25 21:22:24.012231 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Jul 25 21:22:24.012231 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 263/509] 10.222.0.66 () {56 vars in 1102 bytes} [Mon Jul 25 21:22:23 2022] GET /identity/v3/users/neutron => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:22:24.012231 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7053eee0-de69-421f-847d-d1b86e447f11 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:24.085272 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fac5d56-08ae-4ae7-a5e2-e532a7a560ef None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:24.112304 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7053eee0-de69-421f-847d-d1b86e447f11 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:24.120424 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a096bd2-6c36-4781-aa50-bbb5925bb2a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:24.121074 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a096bd2-6c36-4781-aa50-bbb5925bb2a7 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:24.121404 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a096bd2-6c36-4781-aa50-bbb5925bb2a7 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:24.121679 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a096bd2-6c36-4781-aa50-bbb5925bb2a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:24.132454 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a096bd2-6c36-4781-aa50-bbb5925bb2a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:24.134052 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a096bd2-6c36-4781-aa50-bbb5925bb2a7 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:24.146133 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aed2f4f-8e12-46a4-bfa4-38ac4e0aa669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:24.146781 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aed2f4f-8e12-46a4-bfa4-38ac4e0aa669 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:24.147058 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aed2f4f-8e12-46a4-bfa4-38ac4e0aa669 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:24.147328 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aed2f4f-8e12-46a4-bfa4-38ac4e0aa669 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:24.148101 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application [None req-6a096bd2-6c36-4781-aa50-bbb5925bb2a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:22:24.148101 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:22:24.148101 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:22:24.148101 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:22:24.148101 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:22:24.148101 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:22:24.148101 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:22:24.148101 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:22:24.148101 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:22:24.148101 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:22:24.148101 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:22:24.148101 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:22:24.148101 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:22:24.148101 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:22:24.148101 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:22:24.148886 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:22:24.148886 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:22:24.148886 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:22:24.148886 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:22:24.148886 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:22:24.148886 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:22:24.148886 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:22:24.148886 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:22:24.148886 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application with Lock( Jul 25 21:22:24.148886 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:22:24.148886 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:22:24.148886 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:22:24.148886 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:22:24.148886 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:22:24.148886 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:22:24.148886 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:22:24.148886 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:22:24.149741 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:22:24.149741 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:22:24.149741 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:22:24.149741 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Jul 25 21:22:24.149741 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 247/510] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 25 21:22:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:22:24.150550 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a096bd2-6c36-4781-aa50-bbb5925bb2a7 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:24.154022 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aed2f4f-8e12-46a4-bfa4-38ac4e0aa669 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:24.155506 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aed2f4f-8e12-46a4-bfa4-38ac4e0aa669 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:24.157487 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:24.169817 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application [None req-9aed2f4f-8e12-46a4-bfa4-38ac4e0aa669 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:22:24.169817 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:22:24.169817 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:22:24.169817 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:22:24.169817 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:22:24.169817 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:22:24.169817 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:22:24.169817 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:22:24.169817 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:22:24.169817 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:22:24.169817 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:22:24.169817 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:22:24.169817 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 21:22:24.169817 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 21:22:24.169817 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 21:22:24.170865 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 21:22:24.170865 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:22:24.170865 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:22:24.170865 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:22:24.170865 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:22:24.170865 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:22:24.170865 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:22:24.170865 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:22:24.170865 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application with Lock( Jul 25 21:22:24.170865 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:22:24.170865 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:22:24.170865 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:22:24.170865 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:22:24.170865 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:22:24.170865 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:22:24.170865 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:22:24.170865 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:22:24.171937 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 21:22:24.171937 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 21:22:24.171937 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 21:22:24.171937 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 21:22:24.171937 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 21:22:24.171937 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 21:22:24.171937 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:22:24.171937 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Jul 25 21:22:24.171937 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 264/511] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Jul 25 21:22:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:22:24.171937 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aed2f4f-8e12-46a4-bfa4-38ac4e0aa669 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:24.200662 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:24.259878 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a096bd2-6c36-4781-aa50-bbb5925bb2a7 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:24.271652 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aed2f4f-8e12-46a4-bfa4-38ac4e0aa669 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:24.292823 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8bf08c-cc00-47bc-a748-f3200ec978bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:24.293512 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8bf08c-cc00-47bc-a748-f3200ec978bb None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:24.293789 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8bf08c-cc00-47bc-a748-f3200ec978bb None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:24.294096 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8bf08c-cc00-47bc-a748-f3200ec978bb None admin] PATH_INFO: `/v3/users` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:24.295006 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8bf08c-cc00-47bc-a748-f3200ec978bb None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:24.295313 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8bf08c-cc00-47bc-a748-f3200ec978bb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:24.296962 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8bf08c-cc00-47bc-a748-f3200ec978bb None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:24.314613 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 248/512] 10.222.0.66 () {56 vars in 1137 bytes} [Mon Jul 25 21:22:24 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:24.315001 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8bf08c-cc00-47bc-a748-f3200ec978bb None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:24.321228 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0df3fd-9f44-4af2-99eb-ea04218763b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:24.321864 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0df3fd-9f44-4af2-99eb-ea04218763b2 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:24.322144 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0df3fd-9f44-4af2-99eb-ea04218763b2 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:24.322399 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0df3fd-9f44-4af2-99eb-ea04218763b2 None admin] PATH_INFO: `/v3/users` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:24.323196 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0df3fd-9f44-4af2-99eb-ea04218763b2 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:24.323501 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0df3fd-9f44-4af2-99eb-ea04218763b2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:24.324964 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0df3fd-9f44-4af2-99eb-ea04218763b2 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:24.362098 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 265/513] 10.222.0.66 () {56 vars in 1139 bytes} [Mon Jul 25 21:22:24 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:24.362968 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0df3fd-9f44-4af2-99eb-ea04218763b2 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:24.416224 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:24.420117 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8bf08c-cc00-47bc-a748-f3200ec978bb None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:24.422586 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:24.455251 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a07f74-5fed-4500-a371-470222b2f9c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:24.455956 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a07f74-5fed-4500-a371-470222b2f9c3 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:24.456234 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a07f74-5fed-4500-a371-470222b2f9c3 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:24.456506 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a07f74-5fed-4500-a371-470222b2f9c3 None admin] PATH_INFO: `/v3/domains` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:24.457230 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a07f74-5fed-4500-a371-470222b2f9c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:24.457538 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a07f74-5fed-4500-a371-470222b2f9c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:24.458921 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a07f74-5fed-4500-a371-470222b2f9c3 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:24.466701 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0df3fd-9f44-4af2-99eb-ea04218763b2 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:24.471127 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 249/514] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Jul 25 21:22:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:24.471959 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a07f74-5fed-4500-a371-470222b2f9c3 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:24.502999 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05172ac-e01a-4c75-a144-c52d7336b860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:24.503624 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05172ac-e01a-4c75-a144-c52d7336b860 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:24.503901 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05172ac-e01a-4c75-a144-c52d7336b860 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:24.504171 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05172ac-e01a-4c75-a144-c52d7336b860 None admin] PATH_INFO: `/v3/projects` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:24.504908 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05172ac-e01a-4c75-a144-c52d7336b860 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:24.505246 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05172ac-e01a-4c75-a144-c52d7336b860 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:24.506705 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05172ac-e01a-4c75-a144-c52d7336b860 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:24.524380 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 266/515] 10.222.0.66 () {56 vars in 1148 bytes} [Mon Jul 25 21:22:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:24.525243 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05172ac-e01a-4c75-a144-c52d7336b860 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:24.574630 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a07f74-5fed-4500-a371-470222b2f9c3 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:24.608198 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6a2aa0-1eff-47a5-aff1-b432b5bf2290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:24.608826 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6a2aa0-1eff-47a5-aff1-b432b5bf2290 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:24.609120 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6a2aa0-1eff-47a5-aff1-b432b5bf2290 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:24.609398 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6a2aa0-1eff-47a5-aff1-b432b5bf2290 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:24.627626 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05172ac-e01a-4c75-a144-c52d7336b860 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:24.638413 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:24.644129 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:24.662160 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62827598-89ef-4b1d-af05-649bbe1de89c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:24.662888 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62827598-89ef-4b1d-af05-649bbe1de89c None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:24.663174 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62827598-89ef-4b1d-af05-649bbe1de89c None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:24.663451 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62827598-89ef-4b1d-af05-649bbe1de89c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:24.682308 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6a2aa0-1eff-47a5-aff1-b432b5bf2290 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:24.683725 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6a2aa0-1eff-47a5-aff1-b432b5bf2290 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:24.730970 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62827598-89ef-4b1d-af05-649bbe1de89c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:24.732437 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62827598-89ef-4b1d-af05-649bbe1de89c None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:24.782053 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 250/516] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Jul 25 21:22:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 21:22:24.783121 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6a2aa0-1eff-47a5-aff1-b432b5bf2290 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:24.838568 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 267/517] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Jul 25 21:22:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 21:22:24.839425 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62827598-89ef-4b1d-af05-649bbe1de89c None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:24.840345 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:24.857029 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:24.886344 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6a2aa0-1eff-47a5-aff1-b432b5bf2290 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:24.920861 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaf7563-d258-412e-afbe-756d8e8cdcb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:24.921529 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaf7563-d258-412e-afbe-756d8e8cdcb0 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:24.921802 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaf7563-d258-412e-afbe-756d8e8cdcb0 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:24.922068 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaf7563-d258-412e-afbe-756d8e8cdcb0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:24.929091 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaf7563-d258-412e-afbe-756d8e8cdcb0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:24.930610 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaf7563-d258-412e-afbe-756d8e8cdcb0 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:24.942506 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62827598-89ef-4b1d-af05-649bbe1de89c None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:24.943034 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application [None req-9eaf7563-d258-412e-afbe-756d8e8cdcb0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:22:24.943034 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:22:24.943034 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:22:24.943034 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:22:24.943034 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:22:24.943034 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:22:24.943034 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:22:24.943034 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:22:24.943034 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:22:24.943034 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:22:24.943034 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:22:24.943034 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:22:24.943034 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 21:22:24.943034 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 21:22:24.943034 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 21:22:24.943838 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 21:22:24.943838 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:22:24.943838 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:22:24.943838 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:22:24.943838 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:22:24.943838 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:22:24.943838 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:22:24.943838 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:22:24.943838 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application with Lock( Jul 25 21:22:24.943838 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:22:24.943838 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:22:24.943838 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:22:24.943838 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:22:24.943838 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:22:24.943838 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:22:24.943838 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:22:24.943838 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:22:24.944708 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 21:22:24.944708 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 21:22:24.944708 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 21:22:24.944708 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 21:22:24.944708 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 21:22:24.944708 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 21:22:24.944708 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:22:24.944708 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Jul 25 21:22:24.944708 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 251/518] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Jul 25 21:22:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:22:24.945262 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaf7563-d258-412e-afbe-756d8e8cdcb0 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:24.984729 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b93eac-9d21-491a-9c2c-cc0dd1fb42b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:24.985386 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b93eac-9d21-491a-9c2c-cc0dd1fb42b3 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:24.985669 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b93eac-9d21-491a-9c2c-cc0dd1fb42b3 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:24.985943 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b93eac-9d21-491a-9c2c-cc0dd1fb42b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:24.986932 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b93eac-9d21-491a-9c2c-cc0dd1fb42b3 None admin] RBAC: Adding query filter params (role.id=a3f3fbd04ac04f888e9d384179040765, scope.project.id=7e36d923af474a07adb12209580f12e1, user.id=524584f0d1b64e02a467b47de395c130) {{(pid=87209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:24.987236 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b93eac-9d21-491a-9c2c-cc0dd1fb42b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:24.988686 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b93eac-9d21-491a-9c2c-cc0dd1fb42b3 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:24.994282 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 268/519] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Jul 25 21:22:24 2022] GET /identity/v3/role_assignments?user.id=524584f0d1b64e02a467b47de395c130&scope.project.id=7e36d923af474a07adb12209580f12e1&role.id=a3f3fbd04ac04f888e9d384179040765 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:24.995234 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b93eac-9d21-491a-9c2c-cc0dd1fb42b3 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:25.061364 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaf7563-d258-412e-afbe-756d8e8cdcb0 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:25.082661 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:25.088887 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:25.103833 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295b6126-c94d-47bb-8313-9605fea5da6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:25.104575 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295b6126-c94d-47bb-8313-9605fea5da6d None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:25.104854 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295b6126-c94d-47bb-8313-9605fea5da6d None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:25.105156 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295b6126-c94d-47bb-8313-9605fea5da6d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:25.111680 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b93eac-9d21-491a-9c2c-cc0dd1fb42b3 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:25.117808 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295b6126-c94d-47bb-8313-9605fea5da6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:25.119316 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295b6126-c94d-47bb-8313-9605fea5da6d None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:25.135192 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application [None req-295b6126-c94d-47bb-8313-9605fea5da6d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:22:25.135192 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:22:25.135192 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:22:25.135192 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:22:25.135192 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:22:25.135192 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:22:25.135192 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:22:25.135192 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:22:25.135192 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:22:25.135192 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:22:25.135192 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:22:25.135192 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:22:25.135192 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:22:25.135192 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:22:25.135192 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:22:25.136162 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:22:25.136162 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:22:25.136162 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:22:25.136162 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:22:25.136162 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:22:25.136162 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:22:25.136162 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:22:25.136162 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:22:25.136162 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application with Lock( Jul 25 21:22:25.136162 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:22:25.136162 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:22:25.136162 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:22:25.136162 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:22:25.136162 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:22:25.136162 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:22:25.136162 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:22:25.136162 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:22:25.142269 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:22:25.142269 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:22:25.142269 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:22:25.142269 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Jul 25 21:22:25.142269 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 252/520] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 25 21:22:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:22:25.142269 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295b6126-c94d-47bb-8313-9605fea5da6d None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:25.153265 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819607e3-dfd5-4a73-a367-174ef5a52d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:25.153928 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819607e3-dfd5-4a73-a367-174ef5a52d1f None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:25.154212 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819607e3-dfd5-4a73-a367-174ef5a52d1f None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:25.154485 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819607e3-dfd5-4a73-a367-174ef5a52d1f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:25.167900 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819607e3-dfd5-4a73-a367-174ef5a52d1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:25.169431 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819607e3-dfd5-4a73-a367-174ef5a52d1f None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:25.185158 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application [None req-819607e3-dfd5-4a73-a367-174ef5a52d1f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:22:25.185158 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:22:25.185158 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:22:25.185158 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:22:25.185158 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:22:25.185158 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:22:25.185158 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:22:25.185158 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:22:25.185158 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:22:25.185158 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:22:25.185158 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:22:25.185158 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:22:25.185158 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:22:25.185158 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:22:25.185158 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:22:25.186050 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:22:25.186050 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:22:25.186050 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:22:25.186050 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:22:25.186050 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:22:25.186050 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:22:25.186050 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:22:25.186050 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:22:25.186050 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application with Lock( Jul 25 21:22:25.186050 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:22:25.186050 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:22:25.186050 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:22:25.186050 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:22:25.186050 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:22:25.186050 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:22:25.186050 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:22:25.186050 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:22:25.186904 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:22:25.186904 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:22:25.186904 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:22:25.186904 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Jul 25 21:22:25.187751 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 269/521] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 25 21:22:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:22:25.188239 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819607e3-dfd5-4a73-a367-174ef5a52d1f None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:25.255823 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295b6126-c94d-47bb-8313-9605fea5da6d None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:25.292477 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0da7ba8-f2df-416c-88e6-bfe4282c76cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:25.293123 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0da7ba8-f2df-416c-88e6-bfe4282c76cf None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:25.293659 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0da7ba8-f2df-416c-88e6-bfe4282c76cf None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:25.293659 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0da7ba8-f2df-416c-88e6-bfe4282c76cf None admin] PATH_INFO: `/v3/projects` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:25.294388 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0da7ba8-f2df-416c-88e6-bfe4282c76cf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:25.294696 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0da7ba8-f2df-416c-88e6-bfe4282c76cf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:25.296128 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0da7ba8-f2df-416c-88e6-bfe4282c76cf None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:25.299193 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819607e3-dfd5-4a73-a367-174ef5a52d1f None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:25.320093 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 253/522] 10.222.0.66 () {56 vars in 1148 bytes} [Mon Jul 25 21:22:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:25.320093 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0da7ba8-f2df-416c-88e6-bfe4282c76cf None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:25.334961 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:25.341266 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c3926a-b53f-4766-ad65-a9eb7fe1bc25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:25.341906 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c3926a-b53f-4766-ad65-a9eb7fe1bc25 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:25.342188 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c3926a-b53f-4766-ad65-a9eb7fe1bc25 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:25.342461 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c3926a-b53f-4766-ad65-a9eb7fe1bc25 None admin] PATH_INFO: `/v3/domains` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:25.343155 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c3926a-b53f-4766-ad65-a9eb7fe1bc25 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:25.343532 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c3926a-b53f-4766-ad65-a9eb7fe1bc25 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:25.345919 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c3926a-b53f-4766-ad65-a9eb7fe1bc25 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:25.356156 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:25.365315 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 270/523] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Jul 25 21:22:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:25.365315 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c3926a-b53f-4766-ad65-a9eb7fe1bc25 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:25.436226 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0da7ba8-f2df-416c-88e6-bfe4282c76cf None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:25.464522 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c3926a-b53f-4766-ad65-a9eb7fe1bc25 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:25.471373 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cd3952-6f58-4c7e-a964-19ee5fcf543b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:25.471999 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cd3952-6f58-4c7e-a964-19ee5fcf543b None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:25.472277 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cd3952-6f58-4c7e-a964-19ee5fcf543b None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:25.472541 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cd3952-6f58-4c7e-a964-19ee5fcf543b None admin] PATH_INFO: `/v3/domains` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:25.473252 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cd3952-6f58-4c7e-a964-19ee5fcf543b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:25.473552 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cd3952-6f58-4c7e-a964-19ee5fcf543b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:25.474934 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cd3952-6f58-4c7e-a964-19ee5fcf543b None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:25.491666 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 254/524] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Jul 25 21:22:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:25.491666 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cd3952-6f58-4c7e-a964-19ee5fcf543b None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:25.505738 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953b63b8-4e28-4dbb-9bb4-77b11d1f8ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:25.506423 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953b63b8-4e28-4dbb-9bb4-77b11d1f8ded None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:25.506677 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953b63b8-4e28-4dbb-9bb4-77b11d1f8ded None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:25.506917 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953b63b8-4e28-4dbb-9bb4-77b11d1f8ded None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:25.507695 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953b63b8-4e28-4dbb-9bb4-77b11d1f8ded None admin] RBAC: Adding query filter params (role.id=a3f3fbd04ac04f888e9d384179040765, scope.project.id=7e36d923af474a07adb12209580f12e1, user.id=1b47561e7cd048f79518db147de16c1b) {{(pid=87209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:25.508006 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953b63b8-4e28-4dbb-9bb4-77b11d1f8ded None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:25.509522 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953b63b8-4e28-4dbb-9bb4-77b11d1f8ded None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:25.525110 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 271/525] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Jul 25 21:22:25 2022] GET /identity/v3/role_assignments?user.id=1b47561e7cd048f79518db147de16c1b&scope.project.id=7e36d923af474a07adb12209580f12e1&role.id=a3f3fbd04ac04f888e9d384179040765 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:25.525110 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953b63b8-4e28-4dbb-9bb4-77b11d1f8ded None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:25.593984 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:25.627447 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:25.643769 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cd3952-6f58-4c7e-a964-19ee5fcf543b None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:25.653466 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953b63b8-4e28-4dbb-9bb4-77b11d1f8ded None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:25.696070 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4375ecb-79dc-4e4f-9e38-5632acd28b39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:25.697231 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4375ecb-79dc-4e4f-9e38-5632acd28b39 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:25.697829 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4375ecb-79dc-4e4f-9e38-5632acd28b39 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:25.698299 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4375ecb-79dc-4e4f-9e38-5632acd28b39 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:25.701336 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438c33e6-aba8-4372-97eb-d7ce4621a03d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:25.702450 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438c33e6-aba8-4372-97eb-d7ce4621a03d None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:25.702739 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438c33e6-aba8-4372-97eb-d7ce4621a03d None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:25.703015 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438c33e6-aba8-4372-97eb-d7ce4621a03d None admin] PATH_INFO: `/v3/projects/service` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:25.707820 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4375ecb-79dc-4e4f-9e38-5632acd28b39 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:25.709673 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4375ecb-79dc-4e4f-9e38-5632acd28b39 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:25.712957 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438c33e6-aba8-4372-97eb-d7ce4621a03d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:25.714464 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438c33e6-aba8-4372-97eb-d7ce4621a03d None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:25.723816 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application [None req-e4375ecb-79dc-4e4f-9e38-5632acd28b39 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:22:25.723816 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:22:25.723816 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:22:25.723816 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:22:25.723816 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:22:25.723816 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:22:25.723816 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:22:25.723816 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:22:25.723816 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:22:25.723816 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:22:25.723816 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:22:25.723816 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:22:25.723816 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 21:22:25.723816 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 21:22:25.723816 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 21:22:25.724729 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 21:22:25.724729 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:22:25.724729 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:22:25.724729 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:22:25.724729 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:22:25.724729 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:22:25.724729 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:22:25.724729 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:22:25.724729 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application with Lock( Jul 25 21:22:25.724729 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:22:25.724729 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:22:25.724729 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:22:25.724729 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:22:25.724729 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:22:25.724729 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:22:25.724729 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:22:25.724729 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:22:25.725606 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 21:22:25.725606 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 21:22:25.725606 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 21:22:25.725606 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 21:22:25.725606 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 21:22:25.725606 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 21:22:25.725606 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:22:25.725606 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Jul 25 21:22:25.726473 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 255/526] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Jul 25 21:22:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:22:25.726817 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application [None req-438c33e6-aba8-4372-97eb-d7ce4621a03d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:22:25.726817 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:22:25.726817 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:22:25.726817 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:22:25.726817 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:22:25.726817 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:22:25.726817 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:22:25.726817 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:22:25.726817 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:22:25.726817 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:22:25.726817 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:22:25.726817 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:22:25.726817 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 21:22:25.726817 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 21:22:25.726817 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 21:22:25.727730 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 21:22:25.727730 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:22:25.727730 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:22:25.727730 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:22:25.727730 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:22:25.727730 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:22:25.727730 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:22:25.727730 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:22:25.727730 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application with Lock( Jul 25 21:22:25.727730 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:22:25.727730 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:22:25.727730 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:22:25.727730 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:22:25.727730 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:22:25.727730 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:22:25.727730 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:22:25.727730 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:22:25.728573 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 21:22:25.728573 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 21:22:25.728573 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 21:22:25.728573 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 21:22:25.728573 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 21:22:25.728573 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 21:22:25.728573 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:22:25.728573 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Jul 25 21:22:25.728573 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 272/527] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Jul 25 21:22:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:22:25.732349 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4375ecb-79dc-4e4f-9e38-5632acd28b39 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:25.737609 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438c33e6-aba8-4372-97eb-d7ce4621a03d None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:25.840557 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4375ecb-79dc-4e4f-9e38-5632acd28b39 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:25.849147 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438c33e6-aba8-4372-97eb-d7ce4621a03d None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:25.867790 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:25.881586 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9470efb3-40b2-481f-8f8f-62b1af2d8ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:25.882233 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9470efb3-40b2-481f-8f8f-62b1af2d8ebf None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:25.882513 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9470efb3-40b2-481f-8f8f-62b1af2d8ebf None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:25.882785 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9470efb3-40b2-481f-8f8f-62b1af2d8ebf None admin] PATH_INFO: `/v3/projects` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:25.883539 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9470efb3-40b2-481f-8f8f-62b1af2d8ebf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:25.883843 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9470efb3-40b2-481f-8f8f-62b1af2d8ebf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:25.887861 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9470efb3-40b2-481f-8f8f-62b1af2d8ebf None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:25.904390 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a29345-daac-4d39-b0ba-b01ee43f2b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:25.905257 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 256/528] 10.222.0.66 () {56 vars in 1148 bytes} [Mon Jul 25 21:22:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:22:25.905717 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a29345-daac-4d39-b0ba-b01ee43f2b8e None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:25.906279 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a29345-daac-4d39-b0ba-b01ee43f2b8e None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:25.906767 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a29345-daac-4d39-b0ba-b01ee43f2b8e None admin] PATH_INFO: `/v3/projects` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:25.907757 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a29345-daac-4d39-b0ba-b01ee43f2b8e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:25.908285 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a29345-daac-4d39-b0ba-b01ee43f2b8e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:25.910081 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a29345-daac-4d39-b0ba-b01ee43f2b8e None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:25.911222 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9470efb3-40b2-481f-8f8f-62b1af2d8ebf None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:25.924270 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:25.929489 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 273/529] 10.222.0.66 () {56 vars in 1148 bytes} [Mon Jul 25 21:22:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:22:25.931021 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a29345-daac-4d39-b0ba-b01ee43f2b8e None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:26.029604 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9470efb3-40b2-481f-8f8f-62b1af2d8ebf None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:26.054541 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a29345-daac-4d39-b0ba-b01ee43f2b8e None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:26.064578 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529bfd81-abac-4738-bd61-00c57a85a570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:26.065350 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529bfd81-abac-4738-bd61-00c57a85a570 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:26.065735 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529bfd81-abac-4738-bd61-00c57a85a570 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:26.066017 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529bfd81-abac-4738-bd61-00c57a85a570 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:26.066829 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529bfd81-abac-4738-bd61-00c57a85a570 None admin] RBAC: Adding query filter params (role.id=a3f3fbd04ac04f888e9d384179040765, scope.project.id=7e36d923af474a07adb12209580f12e1, user.id=b36a8b42b275490d8f7fbd4e16f398fa) {{(pid=87210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:26.067142 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529bfd81-abac-4738-bd61-00c57a85a570 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:26.068597 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529bfd81-abac-4738-bd61-00c57a85a570 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:26.075053 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 257/530] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Jul 25 21:22:25 2022] GET /identity/v3/role_assignments?user.id=b36a8b42b275490d8f7fbd4e16f398fa&scope.project.id=7e36d923af474a07adb12209580f12e1&role.id=a3f3fbd04ac04f888e9d384179040765 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:26.099721 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e15f901-92c3-4e19-8c54-d0e9c291eafd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:26.100734 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e15f901-92c3-4e19-8c54-d0e9c291eafd None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:26.101311 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e15f901-92c3-4e19-8c54-d0e9c291eafd None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:26.101847 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e15f901-92c3-4e19-8c54-d0e9c291eafd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:26.102910 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e15f901-92c3-4e19-8c54-d0e9c291eafd None admin] RBAC: Adding query filter params (role.id=a3f3fbd04ac04f888e9d384179040765, scope.project.id=7e36d923af474a07adb12209580f12e1, user.id=704ea1ca162d4df3ab560d910d599851) {{(pid=87209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:26.103430 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e15f901-92c3-4e19-8c54-d0e9c291eafd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:26.105295 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e15f901-92c3-4e19-8c54-d0e9c291eafd None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:26.113411 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 274/531] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Jul 25 21:22:25 2022] GET /identity/v3/role_assignments?user.id=704ea1ca162d4df3ab560d910d599851&scope.project.id=7e36d923af474a07adb12209580f12e1&role.id=a3f3fbd04ac04f888e9d384179040765 => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:27.295479 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6fb1ba-7020-42da-aacf-b1662f267b94 None None] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:27.296031 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6fb1ba-7020-42da-aacf-b1662f267b94 None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:27.296031 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6fb1ba-7020-42da-aacf-b1662f267b94 None None] PATH_INFO: `/` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:27.297689 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 258/532] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:22:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:22:27.303351 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e060da8-9f21-4816-9234-ff25c328a10b None None] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:27.303779 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e060da8-9f21-4816-9234-ff25c328a10b None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:27.303952 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e060da8-9f21-4816-9234-ff25c328a10b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:27.323932 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.auth.core [None req-1e060da8-9f21-4816-9234-ff25c328a10b None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:22:27.325191 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-1e060da8-9f21-4816-9234-ff25c328a10b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:22:27.362368 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:27.401690 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 275/533] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:22:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:22:27.430193 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6fb1ba-7020-42da-aacf-b1662f267b94 None None] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:27.508865 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:27.535581 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6fb1ba-7020-42da-aacf-b1662f267b94 None None] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:27.576580 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de2663b-13bb-40d2-8c5e-e042f2fbcfeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:27.577609 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de2663b-13bb-40d2-8c5e-e042f2fbcfeb None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:27.578090 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de2663b-13bb-40d2-8c5e-e042f2fbcfeb None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:27.578558 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de2663b-13bb-40d2-8c5e-e042f2fbcfeb None admin] PATH_INFO: `/v3/roles/service` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:27.590593 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de2663b-13bb-40d2-8c5e-e042f2fbcfeb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:22:27.596285 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application [None req-0de2663b-13bb-40d2-8c5e-e042f2fbcfeb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 21:22:27.596285 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:22:27.596285 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:22:27.596285 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:22:27.596285 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:22:27.596285 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:22:27.596285 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:22:27.596285 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:22:27.596285 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:22:27.596285 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:22:27.596285 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:22:27.596285 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:22:27.596285 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:22:27.596285 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:22:27.596285 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:22:27.596285 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:22:27.597250 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:22:27.597250 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:22:27.597250 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:22:27.597250 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:22:27.597250 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:22:27.597250 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:22:27.597250 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:22:27.597250 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:22:27.597250 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:22:27.597250 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:22:27.597250 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:22:27.597250 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application with Lock( Jul 25 21:22:27.597250 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:22:27.597250 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:22:27.597250 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:22:27.597250 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:22:27.598070 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:22:27.598070 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:22:27.598070 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:22:27.598070 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:22:27.598070 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:22:27.598070 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:22:27.598070 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:22:27.598070 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:22:27.598070 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:22:27.598070 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:22:27.598070 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 21:22:27.598070 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Jul 25 21:22:27.600887 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 259/534] 10.222.0.66 () {56 vars in 1102 bytes} [Mon Jul 25 21:22:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:22:27.610226 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e060da8-9f21-4816-9234-ff25c328a10b None None] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:27.718066 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e060da8-9f21-4816-9234-ff25c328a10b None None] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:27.756776 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a126d9bd-04bd-4753-a509-a0682763dfd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:27.757785 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a126d9bd-04bd-4753-a509-a0682763dfd0 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:27.758254 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a126d9bd-04bd-4753-a509-a0682763dfd0 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:27.758710 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a126d9bd-04bd-4753-a509-a0682763dfd0 None admin] PATH_INFO: `/v3/roles` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:27.759648 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a126d9bd-04bd-4753-a509-a0682763dfd0 None admin] RBAC: Adding query filter params (name=service) {{(pid=87209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:27.760134 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a126d9bd-04bd-4753-a509-a0682763dfd0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:27.761775 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a126d9bd-04bd-4753-a509-a0682763dfd0 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:27.771082 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 276/535] 10.222.0.66 () {56 vars in 1103 bytes} [Mon Jul 25 21:22:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:27.779092 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de2663b-13bb-40d2-8c5e-e042f2fbcfeb None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:27.869469 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e66ed9-c21a-44d1-b17d-52a680ae3fbd None None] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:27.870353 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e66ed9-c21a-44d1-b17d-52a680ae3fbd None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:27.870974 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e66ed9-c21a-44d1-b17d-52a680ae3fbd None None] PATH_INFO: `/` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:27.873063 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 277/536] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:22:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 21:22:27.878943 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f50f2cd-db77-424b-9c4f-332b3df7c5a9 None None] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:27.879460 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f50f2cd-db77-424b-9c4f-332b3df7c5a9 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:27.879962 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f50f2cd-db77-424b-9c4f-332b3df7c5a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:27.894485 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de2663b-13bb-40d2-8c5e-e042f2fbcfeb None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:27.906301 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.auth.core [None req-2f50f2cd-db77-424b-9c4f-332b3df7c5a9 None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:22:27.908312 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-2f50f2cd-db77-424b-9c4f-332b3df7c5a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:22:27.941152 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fe55b1-9fe5-4f52-986a-e49c941c472c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:27.941517 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:27.941809 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fe55b1-9fe5-4f52-986a-e49c941c472c None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:27.942083 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fe55b1-9fe5-4f52-986a-e49c941c472c None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:27.942352 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fe55b1-9fe5-4f52-986a-e49c941c472c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:27.944405 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:27.960299 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fe55b1-9fe5-4f52-986a-e49c941c472c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:27.963168 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fe55b1-9fe5-4f52-986a-e49c941c472c None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:27.985955 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application [None req-43fe55b1-9fe5-4f52-986a-e49c941c472c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:22:27.985955 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:22:27.985955 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:22:27.985955 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:22:27.985955 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:22:27.985955 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:22:27.985955 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:22:27.985955 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:22:27.985955 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:22:27.985955 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:22:27.985955 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:22:27.985955 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:22:27.985955 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:22:27.985955 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:22:27.985955 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:22:27.987321 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:22:27.987321 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:22:27.987321 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:22:27.987321 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:22:27.987321 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:22:27.987321 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:22:27.987321 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:22:27.987321 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:22:27.987321 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application with Lock( Jul 25 21:22:27.987321 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:22:27.987321 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:22:27.987321 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:22:27.987321 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:22:27.987321 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:22:27.987321 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:22:27.987321 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:22:27.987321 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:22:27.988204 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:22:27.988204 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:22:27.988204 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:22:27.988204 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Jul 25 21:22:27.995496 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 260/537] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 25 21:22:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:22:27.996757 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fe55b1-9fe5-4f52-986a-e49c941c472c None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:28.002375 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 278/538] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:22:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 21:22:28.025926 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f50f2cd-db77-424b-9c4f-332b3df7c5a9 None None] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:28.110481 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fe55b1-9fe5-4f52-986a-e49c941c472c None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:28.132758 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f50f2cd-db77-424b-9c4f-332b3df7c5a9 None None] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:28.148629 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfb6adf-3306-4348-89b3-2c26474a1158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:28.149624 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfb6adf-3306-4348-89b3-2c26474a1158 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:28.150124 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfb6adf-3306-4348-89b3-2c26474a1158 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:28.150653 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfb6adf-3306-4348-89b3-2c26474a1158 None admin] PATH_INFO: `/v3/domains` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:28.151672 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfb6adf-3306-4348-89b3-2c26474a1158 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:28.152171 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfb6adf-3306-4348-89b3-2c26474a1158 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:28.153794 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfb6adf-3306-4348-89b3-2c26474a1158 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:28.169348 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 261/539] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Jul 25 21:22:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:28.169523 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43db8e72-46b5-43f2-990b-c8d6c3bd1972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:28.170138 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43db8e72-46b5-43f2-990b-c8d6c3bd1972 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:28.170413 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43db8e72-46b5-43f2-990b-c8d6c3bd1972 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:28.170749 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43db8e72-46b5-43f2-990b-c8d6c3bd1972 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:28.177234 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfb6adf-3306-4348-89b3-2c26474a1158 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:28.182565 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43db8e72-46b5-43f2-990b-c8d6c3bd1972 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:22:28.187617 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application [None req-43db8e72-46b5-43f2-990b-c8d6c3bd1972 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 21:22:28.187617 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:22:28.187617 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:22:28.187617 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:22:28.187617 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:22:28.187617 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:22:28.187617 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:22:28.187617 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:22:28.187617 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:22:28.187617 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:22:28.187617 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:22:28.187617 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:22:28.187617 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:22:28.187617 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:22:28.187617 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:22:28.187617 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:22:28.188700 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:22:28.188700 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:22:28.188700 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:22:28.188700 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:22:28.188700 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:22:28.188700 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:22:28.188700 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:22:28.188700 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:22:28.188700 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:22:28.188700 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:22:28.188700 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:22:28.188700 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application with Lock( Jul 25 21:22:28.188700 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:22:28.188700 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:22:28.188700 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:22:28.188700 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:22:28.189891 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:22:28.189891 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:22:28.189891 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:22:28.189891 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:22:28.189891 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:22:28.189891 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:22:28.189891 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:22:28.189891 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:22:28.189891 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:22:28.189891 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:22:28.189891 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 21:22:28.189891 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Jul 25 21:22:28.193937 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 279/540] 10.222.0.66 () {56 vars in 1102 bytes} [Mon Jul 25 21:22:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:22:28.195275 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43db8e72-46b5-43f2-990b-c8d6c3bd1972 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:28.221586 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:28.233412 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:28.296227 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfb6adf-3306-4348-89b3-2c26474a1158 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:28.312342 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43db8e72-46b5-43f2-990b-c8d6c3bd1972 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:28.335399 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aef30f-2bcc-4dfa-8ef0-d4a9139fb2f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:28.336412 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aef30f-2bcc-4dfa-8ef0-d4a9139fb2f1 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:28.336559 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aef30f-2bcc-4dfa-8ef0-d4a9139fb2f1 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:28.336719 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aef30f-2bcc-4dfa-8ef0-d4a9139fb2f1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:28.344755 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67aef30f-2bcc-4dfa-8ef0-d4a9139fb2f1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:28.346585 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67aef30f-2bcc-4dfa-8ef0-d4a9139fb2f1 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:28.351754 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ae7dbf-ac0b-4543-a97c-a7017e4d2fba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:28.352656 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ae7dbf-ac0b-4543-a97c-a7017e4d2fba None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:28.353072 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ae7dbf-ac0b-4543-a97c-a7017e4d2fba None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:28.353501 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ae7dbf-ac0b-4543-a97c-a7017e4d2fba None admin] PATH_INFO: `/v3/roles` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:28.354342 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ae7dbf-ac0b-4543-a97c-a7017e4d2fba None admin] RBAC: Adding query filter params (name=service) {{(pid=87209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:28.354796 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ae7dbf-ac0b-4543-a97c-a7017e4d2fba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:28.356304 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ae7dbf-ac0b-4543-a97c-a7017e4d2fba None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:28.359253 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application [None req-67aef30f-2bcc-4dfa-8ef0-d4a9139fb2f1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 21:22:28.359253 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:22:28.359253 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:22:28.359253 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:22:28.359253 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:22:28.359253 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:22:28.359253 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:22:28.359253 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:22:28.359253 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:22:28.359253 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:22:28.359253 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:22:28.359253 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:22:28.359253 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 21:22:28.359253 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 21:22:28.359253 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 21:22:28.359253 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 21:22:28.360453 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:22:28.360453 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:22:28.360453 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 21:22:28.360453 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:22:28.360453 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 21:22:28.360453 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:22:28.360453 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:22:28.360453 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:22:28.360453 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:22:28.360453 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:22:28.360453 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:22:28.360453 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application with Lock( Jul 25 21:22:28.360453 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:22:28.360453 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:22:28.360453 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:22:28.360453 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:22:28.360453 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:22:28.360453 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:22:28.361803 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:22:28.361803 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:22:28.361803 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 21:22:28.361803 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 21:22:28.361803 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 21:22:28.361803 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 21:22:28.361803 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 21:22:28.361803 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 21:22:28.361803 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 21:22:28.361803 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Jul 25 21:22:28.365528 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 262/541] 10.222.0.66 () {56 vars in 1093 bytes} [Mon Jul 25 21:22:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:22:28.366841 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aef30f-2bcc-4dfa-8ef0-d4a9139fb2f1 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:28.373622 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 280/542] 10.222.0.66 () {56 vars in 1103 bytes} [Mon Jul 25 21:22:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:28.375291 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ae7dbf-ac0b-4543-a97c-a7017e4d2fba None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:28.473640 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:28.474783 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aef30f-2bcc-4dfa-8ef0-d4a9139fb2f1 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:28.481795 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:28.489761 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ae7dbf-ac0b-4543-a97c-a7017e4d2fba None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:28.510612 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59a6e9c-917c-450d-9709-2d12595ac8ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:28.511236 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59a6e9c-917c-450d-9709-2d12595ac8ef None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:28.511556 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59a6e9c-917c-450d-9709-2d12595ac8ef None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:28.511817 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59a6e9c-917c-450d-9709-2d12595ac8ef None admin] PATH_INFO: `/v3/users` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:28.512593 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59a6e9c-917c-450d-9709-2d12595ac8ef None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:28.512893 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59a6e9c-917c-450d-9709-2d12595ac8ef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:28.514393 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59a6e9c-917c-450d-9709-2d12595ac8ef None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:28.522582 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9a8453-a558-4cfa-89d3-f654dde4e4e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:28.523208 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9a8453-a558-4cfa-89d3-f654dde4e4e9 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:28.523491 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9a8453-a558-4cfa-89d3-f654dde4e4e9 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:28.523757 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9a8453-a558-4cfa-89d3-f654dde4e4e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:28.531732 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 263/543] 10.222.0.66 () {56 vars in 1133 bytes} [Mon Jul 25 21:22:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:22:28.534457 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9a8453-a558-4cfa-89d3-f654dde4e4e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:28.535914 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9a8453-a558-4cfa-89d3-f654dde4e4e9 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:28.537894 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04cd8fe-ed59-4da3-ba69-ea3410ef3811 None None] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:28.538182 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04cd8fe-ed59-4da3-ba69-ea3410ef3811 None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:28.538444 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04cd8fe-ed59-4da3-ba69-ea3410ef3811 None None] PATH_INFO: `/` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:28.540045 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 264/544] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:22:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:22:28.541054 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c71f0da-6636-49f4-b8a8-435840138b5f None None] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:28.541361 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c71f0da-6636-49f4-b8a8-435840138b5f None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:28.541625 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c71f0da-6636-49f4-b8a8-435840138b5f None None] PATH_INFO: `/` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:28.542955 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 265/545] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:22:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:22:28.543476 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c71f0da-6636-49f4-b8a8-435840138b5f None None] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:28.554020 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application [None req-9d9a8453-a558-4cfa-89d3-f654dde4e4e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:22:28.554020 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:22:28.554020 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:22:28.554020 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:22:28.554020 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:22:28.554020 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:22:28.554020 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:22:28.554020 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:22:28.554020 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:22:28.554020 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:22:28.554020 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:22:28.554020 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:22:28.554020 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:22:28.554020 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:22:28.554020 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:22:28.554926 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:22:28.554926 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:22:28.554926 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:22:28.554926 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:22:28.554926 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:22:28.554926 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:22:28.554926 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:22:28.554926 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:22:28.554926 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application with Lock( Jul 25 21:22:28.554926 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:22:28.554926 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:22:28.554926 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:22:28.554926 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:22:28.554926 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:22:28.554926 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:22:28.554926 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:22:28.554926 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:22:28.555750 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:22:28.555750 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:22:28.555750 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:22:28.555750 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Jul 25 21:22:28.555750 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 281/546] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 25 21:22:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:22:28.556752 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ac23ed-ff23-4167-932b-2ef34df2f37b None None] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:28.557031 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ac23ed-ff23-4167-932b-2ef34df2f37b None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:28.557331 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ac23ed-ff23-4167-932b-2ef34df2f37b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:28.575605 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.auth.core [None req-31ac23ed-ff23-4167-932b-2ef34df2f37b None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:22:28.576860 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-31ac23ed-ff23-4167-932b-2ef34df2f37b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:22:28.643374 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 282/547] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:22:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:22:28.644649 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd58d718-8981-4baf-9d0c-5c58cb385ccd None None] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:28.644936 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd58d718-8981-4baf-9d0c-5c58cb385ccd None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:28.645269 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd58d718-8981-4baf-9d0c-5c58cb385ccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:28.649034 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c71f0da-6636-49f4-b8a8-435840138b5f None None] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:28.663275 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.auth.core [None req-cd58d718-8981-4baf-9d0c-5c58cb385ccd None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:22:28.664573 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-cd58d718-8981-4baf-9d0c-5c58cb385ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:22:28.684955 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8f9460-0f4e-4073-bdb2-4595383996d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:28.685637 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8f9460-0f4e-4073-bdb2-4595383996d1 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:28.685911 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8f9460-0f4e-4073-bdb2-4595383996d1 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:28.686181 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8f9460-0f4e-4073-bdb2-4595383996d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:28.696569 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8f9460-0f4e-4073-bdb2-4595383996d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:28.698061 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8f9460-0f4e-4073-bdb2-4595383996d1 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:28.713071 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application [None req-1f8f9460-0f4e-4073-bdb2-4595383996d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:22:28.713071 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:22:28.713071 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:22:28.713071 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:22:28.713071 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:22:28.713071 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:22:28.713071 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:22:28.713071 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:22:28.713071 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:22:28.713071 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:22:28.713071 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:22:28.713071 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:22:28.713071 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:22:28.713071 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:22:28.713071 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:22:28.714092 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:22:28.714092 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:22:28.714092 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:22:28.714092 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:22:28.714092 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:22:28.714092 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:22:28.714092 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:22:28.714092 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:22:28.714092 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application with Lock( Jul 25 21:22:28.714092 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:22:28.714092 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:22:28.714092 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:22:28.714092 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:22:28.714092 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:22:28.714092 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:22:28.714092 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:22:28.714092 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:22:28.715120 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:22:28.715120 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:22:28.715120 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:22:28.715120 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Jul 25 21:22:28.715120 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 266/548] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 25 21:22:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:22:28.715120 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8f9460-0f4e-4073-bdb2-4595383996d1 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:28.725884 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:28.733638 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:28.734407 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 283/549] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:22:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:22:28.735208 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd58d718-8981-4baf-9d0c-5c58cb385ccd None None] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:28.817457 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8f9460-0f4e-4073-bdb2-4595383996d1 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:28.838330 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd58d718-8981-4baf-9d0c-5c58cb385ccd None None] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:28.851294 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41e6ad9-092e-4a44-aabc-869b106d775c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:28.852018 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41e6ad9-092e-4a44-aabc-869b106d775c None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:28.852351 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41e6ad9-092e-4a44-aabc-869b106d775c None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:28.852682 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41e6ad9-092e-4a44-aabc-869b106d775c None admin] PATH_INFO: `/v3/domains` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:28.853454 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41e6ad9-092e-4a44-aabc-869b106d775c None admin] RBAC: Adding query filter params (name=Default) {{(pid=87210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:28.853755 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41e6ad9-092e-4a44-aabc-869b106d775c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:28.855157 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41e6ad9-092e-4a44-aabc-869b106d775c None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:28.867002 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 267/550] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Jul 25 21:22:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:28.867844 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41e6ad9-092e-4a44-aabc-869b106d775c None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:28.873662 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0449a7-1834-460b-a4f9-4e1c384700be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:28.874338 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0449a7-1834-460b-a4f9-4e1c384700be None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:28.874622 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0449a7-1834-460b-a4f9-4e1c384700be None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:28.874897 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0449a7-1834-460b-a4f9-4e1c384700be None admin] PATH_INFO: `/v3/roles/service` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:28.887333 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0449a7-1834-460b-a4f9-4e1c384700be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:22:28.892311 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application [None req-0f0449a7-1834-460b-a4f9-4e1c384700be None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 21:22:28.892311 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:22:28.892311 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:22:28.892311 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:22:28.892311 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:22:28.892311 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:22:28.892311 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:22:28.892311 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:22:28.892311 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:22:28.892311 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:22:28.892311 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:22:28.892311 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:22:28.892311 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:22:28.892311 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:22:28.892311 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:22:28.892311 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:22:28.893485 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:22:28.893485 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:22:28.893485 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:22:28.893485 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:22:28.893485 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:22:28.893485 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:22:28.893485 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:22:28.893485 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:22:28.893485 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:22:28.893485 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:22:28.893485 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:22:28.893485 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application with Lock( Jul 25 21:22:28.893485 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:22:28.893485 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:22:28.893485 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:22:28.893485 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:22:28.894284 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:22:28.894284 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:22:28.894284 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:22:28.894284 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:22:28.894284 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:22:28.894284 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:22:28.894284 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:22:28.894284 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:22:28.894284 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:22:28.894284 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:22:28.894284 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 21:22:28.894284 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Jul 25 21:22:28.894284 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 284/551] 10.222.0.66 () {56 vars in 1102 bytes} [Mon Jul 25 21:22:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:22:28.894952 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0449a7-1834-460b-a4f9-4e1c384700be None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:28.953742 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:28.956761 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:28.980229 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41e6ad9-092e-4a44-aabc-869b106d775c None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:28.999267 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0449a7-1834-460b-a4f9-4e1c384700be None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:29.014933 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3120edbc-f61d-49d6-83a0-d670ea082100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:29.015569 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3120edbc-f61d-49d6-83a0-d670ea082100 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:29.015858 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3120edbc-f61d-49d6-83a0-d670ea082100 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:29.016132 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3120edbc-f61d-49d6-83a0-d670ea082100 None admin] PATH_INFO: `/v3/domains` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:29.016827 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3120edbc-f61d-49d6-83a0-d670ea082100 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:29.017152 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3120edbc-f61d-49d6-83a0-d670ea082100 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:29.019064 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3120edbc-f61d-49d6-83a0-d670ea082100 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:29.030589 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 268/552] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Jul 25 21:22:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:29.031381 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3120edbc-f61d-49d6-83a0-d670ea082100 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:29.033445 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3211b7-390e-4698-82f5-65c9bfe1a62c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:29.034106 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3211b7-390e-4698-82f5-65c9bfe1a62c None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:29.034434 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3211b7-390e-4698-82f5-65c9bfe1a62c None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:29.034711 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3211b7-390e-4698-82f5-65c9bfe1a62c None admin] PATH_INFO: `/v3/roles/service` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:29.045874 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3211b7-390e-4698-82f5-65c9bfe1a62c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:22:29.051032 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application [None req-4d3211b7-390e-4698-82f5-65c9bfe1a62c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 21:22:29.051032 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:22:29.051032 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:22:29.051032 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:22:29.051032 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:22:29.051032 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:22:29.051032 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:22:29.051032 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:22:29.051032 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:22:29.051032 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:22:29.051032 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:22:29.051032 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:22:29.051032 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:22:29.051032 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:22:29.051032 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:22:29.051032 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:22:29.052011 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:22:29.052011 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:22:29.052011 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:22:29.052011 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:22:29.052011 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:22:29.052011 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:22:29.052011 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:22:29.052011 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:22:29.052011 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:22:29.052011 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:22:29.052011 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:22:29.052011 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application with Lock( Jul 25 21:22:29.052011 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:22:29.052011 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:22:29.052011 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:22:29.052011 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:22:29.052812 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:22:29.052812 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:22:29.052812 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:22:29.052812 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:22:29.052812 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:22:29.052812 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:22:29.052812 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:22:29.052812 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:22:29.052812 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:22:29.052812 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:22:29.052812 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 21:22:29.052812 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Jul 25 21:22:29.052812 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 285/553] 10.222.0.66 () {56 vars in 1102 bytes} [Mon Jul 25 21:22:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:22:29.053504 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3211b7-390e-4698-82f5-65c9bfe1a62c None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:29.136042 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3120edbc-f61d-49d6-83a0-d670ea082100 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:29.160796 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3211b7-390e-4698-82f5-65c9bfe1a62c None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:29.169638 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde66004-3107-4b2b-b798-caa6155bce8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:29.170350 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde66004-3107-4b2b-b798-caa6155bce8c None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:29.170630 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde66004-3107-4b2b-b798-caa6155bce8c None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:29.170934 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde66004-3107-4b2b-b798-caa6155bce8c None admin] PATH_INFO: `/v3/users/glance` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:29.174624 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:29.178028 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:29.180947 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde66004-3107-4b2b-b798-caa6155bce8c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:29.182600 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde66004-3107-4b2b-b798-caa6155bce8c None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:29.194274 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application [None req-fde66004-3107-4b2b-b798-caa6155bce8c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 25 21:22:29.194274 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:22:29.194274 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:22:29.194274 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:22:29.194274 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:22:29.194274 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:22:29.194274 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:22:29.194274 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:22:29.194274 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:22:29.194274 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:22:29.194274 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:22:29.194274 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:22:29.194274 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 21:22:29.194274 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 21:22:29.194274 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 21:22:29.194274 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 21:22:29.195573 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:22:29.195573 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:22:29.195573 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 21:22:29.195573 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:22:29.195573 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 21:22:29.195573 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:22:29.195573 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:22:29.195573 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:22:29.195573 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:22:29.195573 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:22:29.195573 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:22:29.195573 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application with Lock( Jul 25 21:22:29.195573 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:22:29.195573 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:22:29.195573 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:22:29.195573 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:22:29.195573 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:22:29.195573 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:22:29.196747 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:22:29.196747 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:22:29.196747 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 21:22:29.196747 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 21:22:29.196747 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 21:22:29.196747 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 21:22:29.196747 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 21:22:29.196747 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 21:22:29.196747 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 25 21:22:29.196747 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Jul 25 21:22:29.200108 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 269/554] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Jul 25 21:22:29 2022] GET /identity/v3/users/glance => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:22:29.200889 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c7a771-8a12-4c9d-8ab5-b99c9c3d481c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:29.201025 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde66004-3107-4b2b-b798-caa6155bce8c None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:29.201559 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c7a771-8a12-4c9d-8ab5-b99c9c3d481c None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:29.201839 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c7a771-8a12-4c9d-8ab5-b99c9c3d481c None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:29.202115 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c7a771-8a12-4c9d-8ab5-b99c9c3d481c None admin] PATH_INFO: `/v3/roles` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:29.202840 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c7a771-8a12-4c9d-8ab5-b99c9c3d481c None admin] RBAC: Adding query filter params (name=service) {{(pid=87209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:29.203142 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c7a771-8a12-4c9d-8ab5-b99c9c3d481c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:29.204572 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c7a771-8a12-4c9d-8ab5-b99c9c3d481c None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:29.213408 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 286/555] 10.222.0.66 () {56 vars in 1103 bytes} [Mon Jul 25 21:22:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:29.214208 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c7a771-8a12-4c9d-8ab5-b99c9c3d481c None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:29.308143 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde66004-3107-4b2b-b798-caa6155bce8c None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:29.317767 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c7a771-8a12-4c9d-8ab5-b99c9c3d481c None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:29.344150 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602d3405-17b8-4b6b-83cb-613a0c6ddcbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:29.344801 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602d3405-17b8-4b6b-83cb-613a0c6ddcbd None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:29.345110 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602d3405-17b8-4b6b-83cb-613a0c6ddcbd None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:29.345386 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602d3405-17b8-4b6b-83cb-613a0c6ddcbd None admin] PATH_INFO: `/v3/projects/service` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:29.352191 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c381a0e-c3bc-41d9-8dfc-1ab30e78adb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:29.352681 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602d3405-17b8-4b6b-83cb-613a0c6ddcbd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:29.352814 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c381a0e-c3bc-41d9-8dfc-1ab30e78adb9 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:29.353121 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c381a0e-c3bc-41d9-8dfc-1ab30e78adb9 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:29.353400 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c381a0e-c3bc-41d9-8dfc-1ab30e78adb9 None admin] PATH_INFO: `/v3/roles` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:29.354107 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c381a0e-c3bc-41d9-8dfc-1ab30e78adb9 None admin] RBAC: Adding query filter params (name=service) {{(pid=87209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:29.354210 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602d3405-17b8-4b6b-83cb-613a0c6ddcbd None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:29.354412 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c381a0e-c3bc-41d9-8dfc-1ab30e78adb9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:29.355844 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c381a0e-c3bc-41d9-8dfc-1ab30e78adb9 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:29.363750 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 287/556] 10.222.0.66 () {56 vars in 1103 bytes} [Mon Jul 25 21:22:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:29.364525 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c381a0e-c3bc-41d9-8dfc-1ab30e78adb9 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:29.365680 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application [None req-602d3405-17b8-4b6b-83cb-613a0c6ddcbd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:22:29.365680 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:22:29.365680 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:22:29.365680 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:22:29.365680 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:22:29.365680 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:22:29.365680 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:22:29.365680 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:22:29.365680 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:22:29.365680 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:22:29.365680 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:22:29.365680 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:22:29.365680 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 21:22:29.365680 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 21:22:29.365680 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 21:22:29.366552 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 21:22:29.366552 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:22:29.366552 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:22:29.366552 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:22:29.366552 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:22:29.366552 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:22:29.366552 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:22:29.366552 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:22:29.366552 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application with Lock( Jul 25 21:22:29.366552 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:22:29.366552 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:22:29.366552 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:22:29.366552 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:22:29.366552 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:22:29.366552 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:22:29.366552 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:22:29.366552 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:22:29.367457 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 21:22:29.367457 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 21:22:29.367457 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 21:22:29.367457 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 21:22:29.367457 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 21:22:29.367457 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 21:22:29.367457 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:22:29.367457 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Jul 25 21:22:29.367457 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 270/557] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Jul 25 21:22:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:22:29.368635 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602d3405-17b8-4b6b-83cb-613a0c6ddcbd None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:29.406633 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:29.426372 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:29.466844 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c381a0e-c3bc-41d9-8dfc-1ab30e78adb9 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:29.469937 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602d3405-17b8-4b6b-83cb-613a0c6ddcbd None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:29.501594 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68817d98-f18f-4088-aec2-8c621fd014c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:29.502616 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68817d98-f18f-4088-aec2-8c621fd014c9 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:29.502947 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68817d98-f18f-4088-aec2-8c621fd014c9 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:29.503225 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68817d98-f18f-4088-aec2-8c621fd014c9 None admin] PATH_INFO: `/v3/users` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:29.503411 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b7b613-c14c-4f39-95a4-129c422ddfaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:29.504016 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68817d98-f18f-4088-aec2-8c621fd014c9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:29.504117 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b7b613-c14c-4f39-95a4-129c422ddfaa None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:29.504307 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b7b613-c14c-4f39-95a4-129c422ddfaa None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:29.504394 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68817d98-f18f-4088-aec2-8c621fd014c9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:29.504579 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b7b613-c14c-4f39-95a4-129c422ddfaa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:29.505797 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68817d98-f18f-4088-aec2-8c621fd014c9 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:29.517384 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b7b613-c14c-4f39-95a4-129c422ddfaa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:29.517868 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b7b613-c14c-4f39-95a4-129c422ddfaa None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:29.530592 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 288/558] 10.222.0.66 () {56 vars in 1137 bytes} [Mon Jul 25 21:22:29 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:29.530592 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68817d98-f18f-4088-aec2-8c621fd014c9 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:29.545669 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application [None req-30b7b613-c14c-4f39-95a4-129c422ddfaa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:22:29.545669 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:22:29.545669 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:22:29.545669 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:22:29.545669 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:22:29.545669 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:22:29.545669 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:22:29.545669 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:22:29.545669 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:22:29.545669 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:22:29.545669 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:22:29.545669 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:22:29.545669 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:22:29.545669 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:22:29.545669 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:22:29.546626 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:22:29.546626 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:22:29.546626 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:22:29.546626 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:22:29.546626 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:22:29.546626 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:22:29.546626 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:22:29.546626 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:22:29.546626 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application with Lock( Jul 25 21:22:29.546626 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:22:29.546626 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:22:29.546626 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:22:29.546626 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:22:29.546626 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:22:29.546626 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:22:29.546626 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:22:29.546626 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:22:29.547598 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:22:29.547598 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:22:29.547598 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:22:29.547598 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Jul 25 21:22:29.547598 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 271/559] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 25 21:22:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:22:29.549036 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b7b613-c14c-4f39-95a4-129c422ddfaa None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:29.641217 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:29.645004 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68817d98-f18f-4088-aec2-8c621fd014c9 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:29.666058 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b7b613-c14c-4f39-95a4-129c422ddfaa None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:29.674846 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:29.680457 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4b0d81-978e-41d8-9f7c-9d835e4ffdd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:29.681133 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4b0d81-978e-41d8-9f7c-9d835e4ffdd2 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:29.681416 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4b0d81-978e-41d8-9f7c-9d835e4ffdd2 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:29.681687 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4b0d81-978e-41d8-9f7c-9d835e4ffdd2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:29.692184 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4b0d81-978e-41d8-9f7c-9d835e4ffdd2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:29.693678 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4b0d81-978e-41d8-9f7c-9d835e4ffdd2 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:29.699948 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb81b35b-4b16-44d1-a120-6a5e4108a947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:29.700570 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb81b35b-4b16-44d1-a120-6a5e4108a947 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:29.700845 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb81b35b-4b16-44d1-a120-6a5e4108a947 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:29.701141 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb81b35b-4b16-44d1-a120-6a5e4108a947 None admin] PATH_INFO: `/v3/projects` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:29.701894 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb81b35b-4b16-44d1-a120-6a5e4108a947 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:29.702196 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb81b35b-4b16-44d1-a120-6a5e4108a947 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:29.703610 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb81b35b-4b16-44d1-a120-6a5e4108a947 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:29.708480 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application [None req-9e4b0d81-978e-41d8-9f7c-9d835e4ffdd2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:22:29.708480 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:22:29.708480 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:22:29.708480 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:22:29.708480 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:22:29.708480 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:22:29.708480 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:22:29.708480 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:22:29.708480 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:22:29.708480 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:22:29.708480 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:22:29.708480 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:22:29.708480 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:22:29.708480 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:22:29.708480 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:22:29.709630 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:22:29.709630 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:22:29.709630 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:22:29.709630 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:22:29.709630 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:22:29.709630 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:22:29.709630 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:22:29.709630 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:22:29.709630 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application with Lock( Jul 25 21:22:29.709630 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:22:29.709630 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:22:29.709630 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:22:29.709630 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:22:29.709630 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:22:29.709630 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:22:29.709630 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:22:29.709630 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:22:29.715305 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:22:29.715305 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:22:29.715305 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:22:29.715305 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Jul 25 21:22:29.715305 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 289/560] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 25 21:22:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:22:29.715305 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4b0d81-978e-41d8-9f7c-9d835e4ffdd2 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:29.721226 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 272/561] 10.222.0.66 () {56 vars in 1148 bytes} [Mon Jul 25 21:22:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:29.722140 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb81b35b-4b16-44d1-a120-6a5e4108a947 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:29.812492 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4b0d81-978e-41d8-9f7c-9d835e4ffdd2 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:29.822221 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb81b35b-4b16-44d1-a120-6a5e4108a947 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:29.846579 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d507bb6-055f-42bf-9431-652523917cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:29.847245 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d507bb6-055f-42bf-9431-652523917cb7 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:29.847518 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d507bb6-055f-42bf-9431-652523917cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:29.847787 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d507bb6-055f-42bf-9431-652523917cb7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:29.857591 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75de0505-48f3-41fa-9fbd-51b246bfb14f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:29.858206 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75de0505-48f3-41fa-9fbd-51b246bfb14f None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:29.858482 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75de0505-48f3-41fa-9fbd-51b246bfb14f None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:29.858751 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75de0505-48f3-41fa-9fbd-51b246bfb14f None admin] PATH_INFO: `/v3/domains` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:29.859093 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d507bb6-055f-42bf-9431-652523917cb7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:29.859433 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75de0505-48f3-41fa-9fbd-51b246bfb14f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:29.859731 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75de0505-48f3-41fa-9fbd-51b246bfb14f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:29.860602 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d507bb6-055f-42bf-9431-652523917cb7 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:29.861231 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75de0505-48f3-41fa-9fbd-51b246bfb14f None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:29.872673 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 273/562] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Jul 25 21:22:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:29.873518 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75de0505-48f3-41fa-9fbd-51b246bfb14f None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:29.875354 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application [None req-1d507bb6-055f-42bf-9431-652523917cb7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:22:29.875354 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:22:29.875354 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:22:29.875354 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:22:29.875354 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:22:29.875354 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:22:29.875354 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:22:29.875354 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:22:29.875354 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:22:29.875354 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:22:29.875354 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:22:29.875354 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:22:29.875354 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:22:29.875354 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:22:29.875354 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:22:29.876356 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:22:29.876356 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:22:29.876356 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:22:29.876356 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:22:29.876356 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:22:29.876356 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:22:29.876356 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:22:29.876356 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:22:29.876356 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application with Lock( Jul 25 21:22:29.876356 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:22:29.876356 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:22:29.876356 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:22:29.876356 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:22:29.876356 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:22:29.876356 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:22:29.876356 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:22:29.876356 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:22:29.877420 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:22:29.877420 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:22:29.877420 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:22:29.877420 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Jul 25 21:22:29.877420 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 290/563] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 25 21:22:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:22:29.877420 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d507bb6-055f-42bf-9431-652523917cb7 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:29.880334 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:29.906006 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:29.985345 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75de0505-48f3-41fa-9fbd-51b246bfb14f None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:29.989582 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d507bb6-055f-42bf-9431-652523917cb7 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:30.020989 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53326694-3803-44ec-bcb1-16c0ca13e4d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:30.021647 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53326694-3803-44ec-bcb1-16c0ca13e4d4 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:30.021918 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53326694-3803-44ec-bcb1-16c0ca13e4d4 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:30.022185 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53326694-3803-44ec-bcb1-16c0ca13e4d4 None admin] PATH_INFO: `/v3/domains` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:30.022869 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53326694-3803-44ec-bcb1-16c0ca13e4d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:30.023169 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53326694-3803-44ec-bcb1-16c0ca13e4d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:30.024543 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53326694-3803-44ec-bcb1-16c0ca13e4d4 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:30.025915 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b629251b-7823-446a-ba39-d5929086e613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:30.026600 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b629251b-7823-446a-ba39-d5929086e613 None admin] REQUEST_METHOD: `PUT` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:30.026879 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b629251b-7823-446a-ba39-d5929086e613 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:30.027281 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b629251b-7823-446a-ba39-d5929086e613 None admin] PATH_INFO: `/v3/projects/7e36d923af474a07adb12209580f12e1/users/524584f0d1b64e02a467b47de395c130/roles/a3f3fbd04ac04f888e9d384179040765` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:30.037008 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 274/564] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Jul 25 21:22:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:30.038022 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53326694-3803-44ec-bcb1-16c0ca13e4d4 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:30.043910 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b629251b-7823-446a-ba39-d5929086e613 None admin] RBAC: Authorizing `identity:create_grant(project_id=7e36d923af474a07adb12209580f12e1, user_id=524584f0d1b64e02a467b47de395c130, role_id=a3f3fbd04ac04f888e9d384179040765)` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:30.045404 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b629251b-7823-446a-ba39-d5929086e613 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:30.060217 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 291/565] 10.222.0.66 () {58 vars in 1439 bytes} [Mon Jul 25 21:22:29 2022] PUT /identity/v3/projects/7e36d923af474a07adb12209580f12e1/users/524584f0d1b64e02a467b47de395c130/roles/a3f3fbd04ac04f888e9d384179040765 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 21:22:30.061480 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b629251b-7823-446a-ba39-d5929086e613 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:30.131148 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:30.141152 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:30.161144 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53326694-3803-44ec-bcb1-16c0ca13e4d4 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:30.198131 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b629251b-7823-446a-ba39-d5929086e613 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:30.201988 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620618d2-e42f-4e38-8353-a03a884eaeab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:30.202670 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620618d2-e42f-4e38-8353-a03a884eaeab None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:30.202953 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620618d2-e42f-4e38-8353-a03a884eaeab None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:30.203224 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620618d2-e42f-4e38-8353-a03a884eaeab None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:30.212242 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620618d2-e42f-4e38-8353-a03a884eaeab None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:30.213783 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620618d2-e42f-4e38-8353-a03a884eaeab None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:30.227157 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application [None req-620618d2-e42f-4e38-8353-a03a884eaeab None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 21:22:30.227157 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:22:30.227157 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:22:30.227157 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:22:30.227157 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:22:30.227157 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:22:30.227157 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:22:30.227157 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:22:30.227157 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:22:30.227157 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:22:30.227157 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:22:30.227157 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:22:30.227157 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 21:22:30.227157 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 21:22:30.227157 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 21:22:30.227157 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 21:22:30.228188 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:22:30.228188 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:22:30.228188 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 21:22:30.228188 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:22:30.228188 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 21:22:30.228188 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:22:30.228188 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:22:30.228188 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:22:30.228188 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:22:30.228188 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:22:30.228188 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:22:30.228188 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application with Lock( Jul 25 21:22:30.228188 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:22:30.228188 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:22:30.228188 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:22:30.228188 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:22:30.228188 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:22:30.228188 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:22:30.229720 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:22:30.229720 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:22:30.229720 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 21:22:30.229720 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 21:22:30.229720 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 21:22:30.229720 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 21:22:30.229720 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 21:22:30.229720 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 21:22:30.229720 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 21:22:30.229720 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Jul 25 21:22:30.229720 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 275/566] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Jul 25 21:22:30 2022] GET /identity/v3/users/cinder => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:22:30.229720 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620618d2-e42f-4e38-8353-a03a884eaeab None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:30.246061 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9879a7-3f67-4f06-94d9-1ed1589a7420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:30.246614 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9879a7-3f67-4f06-94d9-1ed1589a7420 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:30.247001 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9879a7-3f67-4f06-94d9-1ed1589a7420 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:30.247274 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9879a7-3f67-4f06-94d9-1ed1589a7420 None admin] PATH_INFO: `/v3/domains` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:30.247968 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9879a7-3f67-4f06-94d9-1ed1589a7420 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:30.248269 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9879a7-3f67-4f06-94d9-1ed1589a7420 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:30.250477 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9879a7-3f67-4f06-94d9-1ed1589a7420 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:30.265928 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 292/567] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Jul 25 21:22:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:30.266154 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9879a7-3f67-4f06-94d9-1ed1589a7420 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:30.357644 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620618d2-e42f-4e38-8353-a03a884eaeab None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:30.397035 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9879a7-3f67-4f06-94d9-1ed1589a7420 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:30.400965 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517a0067-4713-429a-89c4-ee537df6d052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:30.401660 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517a0067-4713-429a-89c4-ee537df6d052 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:30.401942 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517a0067-4713-429a-89c4-ee537df6d052 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:30.402218 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517a0067-4713-429a-89c4-ee537df6d052 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:30.412749 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517a0067-4713-429a-89c4-ee537df6d052 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:30.412952 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:30.415650 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517a0067-4713-429a-89c4-ee537df6d052 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:30.428784 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application [None req-517a0067-4713-429a-89c4-ee537df6d052 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 25 21:22:30.428784 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:22:30.428784 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:22:30.428784 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:22:30.428784 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:22:30.428784 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:22:30.428784 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:22:30.428784 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:22:30.428784 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:22:30.428784 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:22:30.428784 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:22:30.428784 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:22:30.428784 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 21:22:30.428784 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 21:22:30.428784 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 21:22:30.428784 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 21:22:30.430615 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:22:30.430615 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:22:30.430615 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 21:22:30.430615 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:22:30.430615 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 21:22:30.430615 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:22:30.430615 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:22:30.430615 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:22:30.430615 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:22:30.430615 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:22:30.430615 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:22:30.430615 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application with Lock( Jul 25 21:22:30.430615 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:22:30.430615 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:22:30.430615 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:22:30.430615 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:22:30.430615 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:22:30.430615 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:22:30.431547 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:22:30.431547 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:22:30.431547 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 21:22:30.431547 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 21:22:30.431547 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 21:22:30.431547 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 21:22:30.431547 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 21:22:30.431547 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 21:22:30.431547 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 25 21:22:30.431547 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Jul 25 21:22:30.431547 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 276/568] 10.222.0.66 () {56 vars in 1102 bytes} [Mon Jul 25 21:22:30 2022] GET /identity/v3/users/neutron => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:22:30.431547 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517a0067-4713-429a-89c4-ee537df6d052 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:30.447014 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ae4c93-4dae-4871-8b09-83284f816fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:30.447676 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ae4c93-4dae-4871-8b09-83284f816fb9 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:30.447973 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ae4c93-4dae-4871-8b09-83284f816fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:30.448213 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ae4c93-4dae-4871-8b09-83284f816fb9 None admin] PATH_INFO: `/v3/users` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:30.448967 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ae4c93-4dae-4871-8b09-83284f816fb9 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:30.449294 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ae4c93-4dae-4871-8b09-83284f816fb9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:30.449438 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:30.450747 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ae4c93-4dae-4871-8b09-83284f816fb9 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:30.471533 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 293/569] 10.222.0.66 () {56 vars in 1137 bytes} [Mon Jul 25 21:22:30 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:30.472454 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ae4c93-4dae-4871-8b09-83284f816fb9 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:30.574268 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517a0067-4713-429a-89c4-ee537df6d052 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:30.608473 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ae4c93-4dae-4871-8b09-83284f816fb9 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:30.621196 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c268897e-1021-432c-9441-2682891aeff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:30.621923 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c268897e-1021-432c-9441-2682891aeff1 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:30.622200 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c268897e-1021-432c-9441-2682891aeff1 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:30.622493 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c268897e-1021-432c-9441-2682891aeff1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:30.630425 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c268897e-1021-432c-9441-2682891aeff1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:30.631896 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c268897e-1021-432c-9441-2682891aeff1 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:30.644629 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application [None req-c268897e-1021-432c-9441-2682891aeff1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:22:30.644629 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:22:30.644629 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:22:30.644629 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:22:30.644629 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:22:30.644629 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:22:30.644629 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:22:30.644629 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:22:30.644629 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:22:30.644629 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:22:30.644629 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:22:30.644629 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:22:30.644629 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 21:22:30.644629 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 21:22:30.644629 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 21:22:30.645641 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 21:22:30.645641 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:22:30.645641 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:22:30.645641 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:22:30.645641 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:22:30.645641 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:22:30.645641 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:22:30.645641 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:22:30.645641 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application with Lock( Jul 25 21:22:30.645641 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:22:30.645641 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:22:30.645641 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:22:30.645641 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:22:30.645641 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:22:30.645641 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:22:30.645641 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:22:30.645641 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:22:30.646512 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 21:22:30.646512 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 21:22:30.646512 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 21:22:30.646512 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 21:22:30.646512 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 21:22:30.646512 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 21:22:30.646512 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:22:30.646512 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Jul 25 21:22:30.646952 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 277/570] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Jul 25 21:22:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:22:30.648102 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c268897e-1021-432c-9441-2682891aeff1 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:30.658230 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7917512c-a775-4fbe-879e-c898d4a23eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:30.659193 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7917512c-a775-4fbe-879e-c898d4a23eb4 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:30.659588 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7917512c-a775-4fbe-879e-c898d4a23eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:30.659872 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7917512c-a775-4fbe-879e-c898d4a23eb4 None admin] PATH_INFO: `/v3/users` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:30.660683 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7917512c-a775-4fbe-879e-c898d4a23eb4 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:30.660993 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7917512c-a775-4fbe-879e-c898d4a23eb4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:30.662491 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7917512c-a775-4fbe-879e-c898d4a23eb4 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:30.685964 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 294/571] 10.222.0.66 () {56 vars in 1139 bytes} [Mon Jul 25 21:22:30 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:30.686756 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7917512c-a775-4fbe-879e-c898d4a23eb4 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:30.720076 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:30.750029 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:30.802510 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c268897e-1021-432c-9441-2682891aeff1 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:30.808628 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7917512c-a775-4fbe-879e-c898d4a23eb4 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:30.849749 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9c3c67-4175-40db-b597-f1a05df71b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:30.850501 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9c3c67-4175-40db-b597-f1a05df71b06 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:30.850779 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9c3c67-4175-40db-b597-f1a05df71b06 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:30.851051 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9c3c67-4175-40db-b597-f1a05df71b06 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:30.852938 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40c5504-f6f7-4df4-8947-dc347f7dd151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:30.854025 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40c5504-f6f7-4df4-8947-dc347f7dd151 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:30.854310 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40c5504-f6f7-4df4-8947-dc347f7dd151 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:30.854744 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40c5504-f6f7-4df4-8947-dc347f7dd151 None admin] PATH_INFO: `/v3/projects` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:30.855518 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40c5504-f6f7-4df4-8947-dc347f7dd151 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:30.855833 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40c5504-f6f7-4df4-8947-dc347f7dd151 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:30.857333 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40c5504-f6f7-4df4-8947-dc347f7dd151 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:30.866548 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9c3c67-4175-40db-b597-f1a05df71b06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:30.869071 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9c3c67-4175-40db-b597-f1a05df71b06 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:30.876587 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 295/572] 10.222.0.66 () {56 vars in 1148 bytes} [Mon Jul 25 21:22:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:30.876587 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40c5504-f6f7-4df4-8947-dc347f7dd151 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:30.894289 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application [None req-4d9c3c67-4175-40db-b597-f1a05df71b06 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:22:30.894289 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:22:30.894289 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:22:30.894289 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:22:30.894289 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:22:30.894289 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:22:30.894289 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:22:30.894289 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:22:30.894289 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:22:30.894289 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:22:30.894289 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:22:30.894289 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:22:30.894289 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:22:30.894289 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:22:30.894289 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:22:30.895263 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:22:30.895263 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:22:30.895263 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:22:30.895263 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:22:30.895263 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:22:30.895263 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:22:30.895263 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:22:30.895263 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:22:30.895263 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application with Lock( Jul 25 21:22:30.895263 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:22:30.895263 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:22:30.895263 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:22:30.895263 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:22:30.895263 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:22:30.895263 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:22:30.895263 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:22:30.895263 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:22:30.896130 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:22:30.896130 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:22:30.896130 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:22:30.896130 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Jul 25 21:22:30.896130 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 278/573] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 25 21:22:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:22:30.896861 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9c3c67-4175-40db-b597-f1a05df71b06 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:31.004430 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:31.020903 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40c5504-f6f7-4df4-8947-dc347f7dd151 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:31.033448 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9c3c67-4175-40db-b597-f1a05df71b06 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:31.061396 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7731e4a4-6b12-4099-b0d3-939cc37a2c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:31.062051 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7731e4a4-6b12-4099-b0d3-939cc37a2c09 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:31.062356 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7731e4a4-6b12-4099-b0d3-939cc37a2c09 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:31.062810 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7731e4a4-6b12-4099-b0d3-939cc37a2c09 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:31.064190 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:31.077122 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7731e4a4-6b12-4099-b0d3-939cc37a2c09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:31.078635 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7731e4a4-6b12-4099-b0d3-939cc37a2c09 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:31.086966 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a009b79-e9c5-4d56-a9e7-4cdf68742ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:31.087902 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a009b79-e9c5-4d56-a9e7-4cdf68742ac6 None admin] REQUEST_METHOD: `PUT` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:31.088188 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a009b79-e9c5-4d56-a9e7-4cdf68742ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:31.088610 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a009b79-e9c5-4d56-a9e7-4cdf68742ac6 None admin] PATH_INFO: `/v3/projects/7e36d923af474a07adb12209580f12e1/users/1b47561e7cd048f79518db147de16c1b/roles/a3f3fbd04ac04f888e9d384179040765` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:31.095082 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application [None req-7731e4a4-6b12-4099-b0d3-939cc37a2c09 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:22:31.095082 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:22:31.095082 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:22:31.095082 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:22:31.095082 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:22:31.095082 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:22:31.095082 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:22:31.095082 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:22:31.095082 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:22:31.095082 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:22:31.095082 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:22:31.095082 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:22:31.095082 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:22:31.095082 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:22:31.095082 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:22:31.095973 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:22:31.095973 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:22:31.095973 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:22:31.095973 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:22:31.095973 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:22:31.095973 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:22:31.095973 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:22:31.095973 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:22:31.095973 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application with Lock( Jul 25 21:22:31.095973 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:22:31.095973 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:22:31.095973 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:22:31.095973 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:22:31.095973 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:22:31.095973 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:22:31.095973 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:22:31.095973 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:22:31.097564 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:22:31.097564 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:22:31.097564 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:22:31.097564 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Jul 25 21:22:31.097564 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 296/574] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 25 21:22:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:22:31.098604 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7731e4a4-6b12-4099-b0d3-939cc37a2c09 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:31.112575 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a009b79-e9c5-4d56-a9e7-4cdf68742ac6 None admin] RBAC: Authorizing `identity:create_grant(project_id=7e36d923af474a07adb12209580f12e1, user_id=1b47561e7cd048f79518db147de16c1b, role_id=a3f3fbd04ac04f888e9d384179040765)` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:31.114013 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a009b79-e9c5-4d56-a9e7-4cdf68742ac6 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:31.132973 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 279/575] 10.222.0.66 () {58 vars in 1439 bytes} [Mon Jul 25 21:22:30 2022] PUT /identity/v3/projects/7e36d923af474a07adb12209580f12e1/users/1b47561e7cd048f79518db147de16c1b/roles/a3f3fbd04ac04f888e9d384179040765 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 21:22:31.134556 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a009b79-e9c5-4d56-a9e7-4cdf68742ac6 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:31.259783 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7731e4a4-6b12-4099-b0d3-939cc37a2c09 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:31.299371 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a43d28-90be-46ae-a342-e1de4bfee656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:31.300021 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a43d28-90be-46ae-a342-e1de4bfee656 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:31.300309 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a43d28-90be-46ae-a342-e1de4bfee656 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:31.300578 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a43d28-90be-46ae-a342-e1de4bfee656 None admin] PATH_INFO: `/v3/domains` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:31.301317 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a43d28-90be-46ae-a342-e1de4bfee656 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:31.301624 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a43d28-90be-46ae-a342-e1de4bfee656 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:31.303034 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a43d28-90be-46ae-a342-e1de4bfee656 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:31.307643 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a009b79-e9c5-4d56-a9e7-4cdf68742ac6 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:31.313792 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:31.318008 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 297/576] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Jul 25 21:22:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:31.323671 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a43d28-90be-46ae-a342-e1de4bfee656 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:31.361612 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05be52ad-1491-4d90-bc8e-06fcdaa3c566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:31.362286 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05be52ad-1491-4d90-bc8e-06fcdaa3c566 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:31.362529 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05be52ad-1491-4d90-bc8e-06fcdaa3c566 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:31.362804 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05be52ad-1491-4d90-bc8e-06fcdaa3c566 None admin] PATH_INFO: `/v3/domains` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:31.363508 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05be52ad-1491-4d90-bc8e-06fcdaa3c566 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:31.363804 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05be52ad-1491-4d90-bc8e-06fcdaa3c566 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:31.365259 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05be52ad-1491-4d90-bc8e-06fcdaa3c566 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:31.380643 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 280/577] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Jul 25 21:22:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:31.386113 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05be52ad-1491-4d90-bc8e-06fcdaa3c566 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:31.420964 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:31.457500 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a43d28-90be-46ae-a342-e1de4bfee656 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:31.498890 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b4d99e-86c6-4a86-89ca-e21092413e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:31.499673 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b4d99e-86c6-4a86-89ca-e21092413e4c None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:31.500069 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b4d99e-86c6-4a86-89ca-e21092413e4c None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:31.500437 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b4d99e-86c6-4a86-89ca-e21092413e4c None admin] PATH_INFO: `/v3/projects/service` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:31.508384 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b4d99e-86c6-4a86-89ca-e21092413e4c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:31.510053 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b4d99e-86c6-4a86-89ca-e21092413e4c None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:31.510861 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05be52ad-1491-4d90-bc8e-06fcdaa3c566 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:31.521692 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application [None req-57b4d99e-86c6-4a86-89ca-e21092413e4c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:22:31.521692 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:22:31.521692 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:22:31.521692 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:22:31.521692 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:22:31.521692 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:22:31.521692 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:22:31.521692 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:22:31.521692 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:22:31.521692 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:22:31.521692 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:22:31.521692 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:22:31.521692 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 21:22:31.521692 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 21:22:31.521692 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 21:22:31.522799 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 21:22:31.522799 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:22:31.522799 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:22:31.522799 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:22:31.522799 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:22:31.522799 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:22:31.522799 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:22:31.522799 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:22:31.522799 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application with Lock( Jul 25 21:22:31.522799 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:22:31.522799 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:22:31.522799 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:22:31.522799 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:22:31.522799 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:22:31.522799 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:22:31.522799 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:22:31.522799 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:22:31.523855 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 21:22:31.523855 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 21:22:31.523855 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 21:22:31.523855 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 21:22:31.523855 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 21:22:31.523855 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 21:22:31.523855 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:22:31.523855 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Jul 25 21:22:31.529985 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 298/578] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Jul 25 21:22:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:22:31.530997 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b4d99e-86c6-4a86-89ca-e21092413e4c None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:31.555852 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4c2cef-d3d0-46d1-a8f8-0d3f2ba74a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:31.556517 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4c2cef-d3d0-46d1-a8f8-0d3f2ba74a74 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:31.556796 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4c2cef-d3d0-46d1-a8f8-0d3f2ba74a74 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:31.557064 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4c2cef-d3d0-46d1-a8f8-0d3f2ba74a74 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:31.564749 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4c2cef-d3d0-46d1-a8f8-0d3f2ba74a74 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:31.566669 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4c2cef-d3d0-46d1-a8f8-0d3f2ba74a74 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:31.579462 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application [None req-8e4c2cef-d3d0-46d1-a8f8-0d3f2ba74a74 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:22:31.579462 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:22:31.579462 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:22:31.579462 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:22:31.579462 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:22:31.579462 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:22:31.579462 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:22:31.579462 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:22:31.579462 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:22:31.579462 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:22:31.579462 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:22:31.579462 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:22:31.579462 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 21:22:31.579462 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 21:22:31.579462 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 21:22:31.580446 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 21:22:31.580446 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:22:31.580446 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:22:31.580446 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:22:31.580446 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:22:31.580446 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:22:31.580446 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:22:31.580446 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:22:31.580446 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application with Lock( Jul 25 21:22:31.580446 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:22:31.580446 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:22:31.580446 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:22:31.580446 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:22:31.580446 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:22:31.580446 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:22:31.580446 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:22:31.580446 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:22:31.581534 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 21:22:31.581534 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 21:22:31.581534 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 21:22:31.581534 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 21:22:31.581534 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 21:22:31.581534 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 21:22:31.581534 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:22:31.581534 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Jul 25 21:22:31.585134 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 281/579] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Jul 25 21:22:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:22:31.588117 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4c2cef-d3d0-46d1-a8f8-0d3f2ba74a74 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:31.614975 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:31.665231 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b4d99e-86c6-4a86-89ca-e21092413e4c None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:31.701474 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:31.709911 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b834ab88-0b1d-474b-9d4c-200774acea84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:31.710786 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b834ab88-0b1d-474b-9d4c-200774acea84 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:31.711232 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b834ab88-0b1d-474b-9d4c-200774acea84 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:31.711699 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b834ab88-0b1d-474b-9d4c-200774acea84 None admin] PATH_INFO: `/v3/projects` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:31.712604 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b834ab88-0b1d-474b-9d4c-200774acea84 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:31.713123 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b834ab88-0b1d-474b-9d4c-200774acea84 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:31.713227 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4c2cef-d3d0-46d1-a8f8-0d3f2ba74a74 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:31.714942 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b834ab88-0b1d-474b-9d4c-200774acea84 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:31.728562 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 299/580] 10.222.0.66 () {56 vars in 1148 bytes} [Mon Jul 25 21:22:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:22:31.734920 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b834ab88-0b1d-474b-9d4c-200774acea84 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:31.753191 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71da9a6b-7868-4b4a-95e7-35a9061e7ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:31.754205 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71da9a6b-7868-4b4a-95e7-35a9061e7ace None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:31.754555 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71da9a6b-7868-4b4a-95e7-35a9061e7ace None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:31.754895 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71da9a6b-7868-4b4a-95e7-35a9061e7ace None admin] PATH_INFO: `/v3/projects` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:31.755718 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71da9a6b-7868-4b4a-95e7-35a9061e7ace None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:31.756220 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71da9a6b-7868-4b4a-95e7-35a9061e7ace None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:31.758106 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71da9a6b-7868-4b4a-95e7-35a9061e7ace None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:31.777260 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 282/581] 10.222.0.66 () {56 vars in 1148 bytes} [Mon Jul 25 21:22:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:31.780319 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71da9a6b-7868-4b4a-95e7-35a9061e7ace None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:31.859213 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b834ab88-0b1d-474b-9d4c-200774acea84 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:31.884351 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:31.900551 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b57a08-4680-4e2c-bf51-1ec05111348a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:31.901268 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b57a08-4680-4e2c-bf51-1ec05111348a None admin] REQUEST_METHOD: `PUT` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:31.901545 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b57a08-4680-4e2c-bf51-1ec05111348a None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:31.901818 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b57a08-4680-4e2c-bf51-1ec05111348a None admin] PATH_INFO: `/v3/projects/7e36d923af474a07adb12209580f12e1/users/b36a8b42b275490d8f7fbd4e16f398fa/roles/a3f3fbd04ac04f888e9d384179040765` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:31.917091 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71da9a6b-7868-4b4a-95e7-35a9061e7ace None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:31.918368 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b57a08-4680-4e2c-bf51-1ec05111348a None admin] RBAC: Authorizing `identity:create_grant(project_id=7e36d923af474a07adb12209580f12e1, user_id=b36a8b42b275490d8f7fbd4e16f398fa, role_id=a3f3fbd04ac04f888e9d384179040765)` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:31.920661 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b57a08-4680-4e2c-bf51-1ec05111348a None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:31.948517 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 300/582] 10.222.0.66 () {58 vars in 1439 bytes} [Mon Jul 25 21:22:31 2022] PUT /identity/v3/projects/7e36d923af474a07adb12209580f12e1/users/b36a8b42b275490d8f7fbd4e16f398fa/roles/a3f3fbd04ac04f888e9d384179040765 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 21:22:31.967431 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17032c4d-9fe5-4fd4-a005-b3d8b86f62ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:31.968542 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17032c4d-9fe5-4fd4-a005-b3d8b86f62ed None admin] REQUEST_METHOD: `PUT` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:31.969020 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17032c4d-9fe5-4fd4-a005-b3d8b86f62ed None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:31.969559 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17032c4d-9fe5-4fd4-a005-b3d8b86f62ed None admin] PATH_INFO: `/v3/projects/7e36d923af474a07adb12209580f12e1/users/704ea1ca162d4df3ab560d910d599851/roles/a3f3fbd04ac04f888e9d384179040765` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:31.990064 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17032c4d-9fe5-4fd4-a005-b3d8b86f62ed None admin] RBAC: Authorizing `identity:create_grant(project_id=7e36d923af474a07adb12209580f12e1, user_id=704ea1ca162d4df3ab560d910d599851, role_id=a3f3fbd04ac04f888e9d384179040765)` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:31.992451 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17032c4d-9fe5-4fd4-a005-b3d8b86f62ed None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:32.004467 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:32.010244 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 283/583] 10.222.0.66 () {58 vars in 1439 bytes} [Mon Jul 25 21:22:31 2022] PUT /identity/v3/projects/7e36d923af474a07adb12209580f12e1/users/704ea1ca162d4df3ab560d910d599851/roles/a3f3fbd04ac04f888e9d384179040765 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 21:22:32.478209 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7375ae21-067b-43e0-aabc-748886d174d2 None None] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:32.478740 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7375ae21-067b-43e0-aabc-748886d174d2 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:32.478740 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7375ae21-067b-43e0-aabc-748886d174d2 None None] PATH_INFO: `/` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:32.480242 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 301/584] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:22:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:22:32.486041 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a71237-c862-4401-b962-9445baa827ed None None] REQUEST_METHOD: `POST` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:32.486567 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a71237-c862-4401-b962-9445baa827ed None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:32.486649 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a71237-c862-4401-b962-9445baa827ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:32.506566 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.auth.core [None req-67a71237-c862-4401-b962-9445baa827ed None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:22:32.507749 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.fernet_utils [None req-67a71237-c862-4401-b962-9445baa827ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:22:32.578223 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 284/585] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:22:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:22:32.602942 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7375ae21-067b-43e0-aabc-748886d174d2 None None] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:32.709207 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7375ae21-067b-43e0-aabc-748886d174d2 None None] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:32.743870 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dcce71-5e74-4094-bffa-6a097486bc51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:32.744856 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dcce71-5e74-4094-bffa-6a097486bc51 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:32.745363 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dcce71-5e74-4094-bffa-6a097486bc51 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:32.745859 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dcce71-5e74-4094-bffa-6a097486bc51 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:32.756558 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dcce71-5e74-4094-bffa-6a097486bc51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:22:32.761878 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application [None req-c8dcce71-5e74-4094-bffa-6a097486bc51 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 21:22:32.761878 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:22:32.761878 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:22:32.761878 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:22:32.761878 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:22:32.761878 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:22:32.761878 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:22:32.761878 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:22:32.761878 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:22:32.761878 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:22:32.761878 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:22:32.761878 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:22:32.761878 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:22:32.761878 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:22:32.761878 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:22:32.761878 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:22:32.762811 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:22:32.762811 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:22:32.762811 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:22:32.762811 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:22:32.762811 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:22:32.762811 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:22:32.762811 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:22:32.762811 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:22:32.762811 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:22:32.762811 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:22:32.762811 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:22:32.762811 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application with Lock( Jul 25 21:22:32.762811 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:22:32.762811 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:22:32.762811 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:22:32.762811 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:22:32.763683 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:22:32.763683 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:22:32.763683 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:22:32.763683 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:22:32.763683 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:22:32.763683 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:22:32.763683 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:22:32.763683 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:22:32.763683 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:22:32.763683 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:22:32.763683 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 21:22:32.763683 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Jul 25 21:22:32.770535 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 302/586] 10.222.0.66 () {56 vars in 1102 bytes} [Mon Jul 25 21:22:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:22:32.772808 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a71237-c862-4401-b962-9445baa827ed None None] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:32.878937 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a71237-c862-4401-b962-9445baa827ed None None] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:32.908486 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:32.914583 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8f83d6-8cbf-4ef6-bbe0-476502045f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:32.915543 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8f83d6-8cbf-4ef6-bbe0-476502045f38 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:32.915820 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8f83d6-8cbf-4ef6-bbe0-476502045f38 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:32.916090 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8f83d6-8cbf-4ef6-bbe0-476502045f38 None admin] PATH_INFO: `/v3/roles` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:32.916808 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8f83d6-8cbf-4ef6-bbe0-476502045f38 None admin] RBAC: Adding query filter params (name=service) {{(pid=87210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:32.917122 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8f83d6-8cbf-4ef6-bbe0-476502045f38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:32.918713 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8f83d6-8cbf-4ef6-bbe0-476502045f38 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:32.927879 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 285/587] 10.222.0.66 () {56 vars in 1103 bytes} [Mon Jul 25 21:22:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:32.933557 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dcce71-5e74-4094-bffa-6a097486bc51 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:32.979059 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:33.053316 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dcce71-5e74-4094-bffa-6a097486bc51 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:33.092273 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795744b0-034d-4262-8f0e-4b573885a523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:33.092971 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795744b0-034d-4262-8f0e-4b573885a523 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:33.093275 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795744b0-034d-4262-8f0e-4b573885a523 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:33.093545 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795744b0-034d-4262-8f0e-4b573885a523 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:33.104331 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795744b0-034d-4262-8f0e-4b573885a523 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:33.105870 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795744b0-034d-4262-8f0e-4b573885a523 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:33.120944 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application [None req-795744b0-034d-4262-8f0e-4b573885a523 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:22:33.120944 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:22:33.120944 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:22:33.120944 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:22:33.120944 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:22:33.120944 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:22:33.120944 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:22:33.120944 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:22:33.120944 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:22:33.120944 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:22:33.120944 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:22:33.120944 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:22:33.120944 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:22:33.120944 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:22:33.120944 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:22:33.121878 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:22:33.121878 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:22:33.121878 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:22:33.121878 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:22:33.121878 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:22:33.121878 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:22:33.121878 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:22:33.121878 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:22:33.121878 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application with Lock( Jul 25 21:22:33.121878 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:22:33.121878 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:22:33.121878 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:22:33.121878 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:22:33.121878 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:22:33.121878 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:22:33.121878 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:22:33.121878 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:22:33.122977 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:22:33.122977 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:22:33.122977 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:22:33.122977 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Jul 25 21:22:33.122977 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 303/588] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 25 21:22:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:22:33.129545 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8f83d6-8cbf-4ef6-bbe0-476502045f38 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:33.235013 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8f83d6-8cbf-4ef6-bbe0-476502045f38 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:33.272023 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d77b11-1945-4bf8-b89d-61d64ddd3abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:33.272664 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d77b11-1945-4bf8-b89d-61d64ddd3abe None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:33.272938 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d77b11-1945-4bf8-b89d-61d64ddd3abe None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:33.273246 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d77b11-1945-4bf8-b89d-61d64ddd3abe None admin] PATH_INFO: `/v3/domains` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:33.273958 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d77b11-1945-4bf8-b89d-61d64ddd3abe None admin] RBAC: Adding query filter params (name=Default) {{(pid=87210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:33.274257 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d77b11-1945-4bf8-b89d-61d64ddd3abe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:33.275821 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d77b11-1945-4bf8-b89d-61d64ddd3abe None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:33.290784 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 286/589] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Jul 25 21:22:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:33.298259 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795744b0-034d-4262-8f0e-4b573885a523 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:33.402373 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:33.422866 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795744b0-034d-4262-8f0e-4b573885a523 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:33.458101 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f9848f-04e6-42ef-a5b3-e7d132428f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:33.458749 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f9848f-04e6-42ef-a5b3-e7d132428f7a None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:33.459024 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f9848f-04e6-42ef-a5b3-e7d132428f7a None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:33.459293 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f9848f-04e6-42ef-a5b3-e7d132428f7a None admin] PATH_INFO: `/v3/users/nova` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:33.467656 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f9848f-04e6-42ef-a5b3-e7d132428f7a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:33.469256 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f9848f-04e6-42ef-a5b3-e7d132428f7a None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:33.480556 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application [None req-76f9848f-04e6-42ef-a5b3-e7d132428f7a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 21:22:33.480556 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:22:33.480556 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:22:33.480556 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:22:33.480556 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:22:33.480556 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:22:33.480556 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:22:33.480556 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:22:33.480556 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:22:33.480556 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:22:33.480556 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:22:33.480556 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:22:33.480556 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 21:22:33.480556 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 21:22:33.480556 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 21:22:33.480556 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 21:22:33.482259 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:22:33.482259 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:22:33.482259 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 21:22:33.482259 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:22:33.482259 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 21:22:33.482259 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:22:33.482259 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:22:33.482259 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:22:33.482259 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:22:33.482259 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:22:33.482259 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:22:33.482259 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application with Lock( Jul 25 21:22:33.482259 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:22:33.482259 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:22:33.482259 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:22:33.482259 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:22:33.482259 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:22:33.482259 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:22:33.483233 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:22:33.483233 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:22:33.483233 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 21:22:33.483233 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 21:22:33.483233 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 21:22:33.483233 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 21:22:33.483233 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 21:22:33.483233 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 21:22:33.483233 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 21:22:33.483233 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Jul 25 21:22:33.483233 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 304/590] 10.222.0.66 () {56 vars in 1093 bytes} [Mon Jul 25 21:22:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:22:33.493510 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d77b11-1945-4bf8-b89d-61d64ddd3abe None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:33.494140 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5ad76b-3dab-44f7-a781-d8a4fd5ec666 None None] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:33.494140 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5ad76b-3dab-44f7-a781-d8a4fd5ec666 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:33.494140 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5ad76b-3dab-44f7-a781-d8a4fd5ec666 None None] PATH_INFO: `/` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:33.494140 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 305/591] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:22:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:22:33.502863 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32431f36-ec0a-45bc-9f64-a26ebb0747c3 None None] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:33.503139 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32431f36-ec0a-45bc-9f64-a26ebb0747c3 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:33.503411 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32431f36-ec0a-45bc-9f64-a26ebb0747c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:33.523415 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.auth.core [None req-32431f36-ec0a-45bc-9f64-a26ebb0747c3 None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:22:33.524536 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-32431f36-ec0a-45bc-9f64-a26ebb0747c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:22:33.555682 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:33.604063 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 306/592] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:22:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 21:22:33.605748 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d77b11-1945-4bf8-b89d-61d64ddd3abe None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:33.623617 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32431f36-ec0a-45bc-9f64-a26ebb0747c3 None None] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:33.640137 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6eb56c-230f-43f7-9ad8-31e8c73a30ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:33.640928 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6eb56c-230f-43f7-9ad8-31e8c73a30ed None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:33.641399 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6eb56c-230f-43f7-9ad8-31e8c73a30ed None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:33.641712 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6eb56c-230f-43f7-9ad8-31e8c73a30ed None admin] PATH_INFO: `/v3/users` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:33.642722 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6eb56c-230f-43f7-9ad8-31e8c73a30ed None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:33.643128 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6eb56c-230f-43f7-9ad8-31e8c73a30ed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:33.644838 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6eb56c-230f-43f7-9ad8-31e8c73a30ed None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:33.664351 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 287/593] 10.222.0.66 () {56 vars in 1133 bytes} [Mon Jul 25 21:22:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:33.674304 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6eb56c-230f-43f7-9ad8-31e8c73a30ed None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:33.704383 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:33.740192 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32431f36-ec0a-45bc-9f64-a26ebb0747c3 None None] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:33.777810 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0e9c0c-0089-4c5b-9ee6-805376377b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:33.778889 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0e9c0c-0089-4c5b-9ee6-805376377b28 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:33.779349 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0e9c0c-0089-4c5b-9ee6-805376377b28 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:33.779791 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0e9c0c-0089-4c5b-9ee6-805376377b28 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:33.784321 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6eb56c-230f-43f7-9ad8-31e8c73a30ed None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:33.792466 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0e9c0c-0089-4c5b-9ee6-805376377b28 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:22:33.796212 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:33.800050 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application [None req-1e0e9c0c-0089-4c5b-9ee6-805376377b28 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 21:22:33.800050 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:22:33.800050 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:22:33.800050 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:22:33.800050 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:22:33.800050 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:22:33.800050 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:22:33.800050 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:22:33.800050 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:22:33.800050 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:22:33.800050 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:22:33.800050 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:22:33.800050 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:22:33.800050 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:22:33.800050 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:22:33.800050 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:22:33.800976 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:22:33.800976 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:22:33.800976 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:22:33.800976 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:22:33.800976 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:22:33.800976 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:22:33.800976 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:22:33.800976 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:22:33.800976 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:22:33.800976 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:22:33.800976 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:22:33.800976 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application with Lock( Jul 25 21:22:33.800976 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:22:33.800976 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:22:33.800976 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:22:33.800976 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:22:33.801873 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:22:33.801873 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:22:33.801873 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:22:33.801873 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:22:33.801873 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:22:33.801873 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:22:33.801873 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:22:33.801873 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:22:33.801873 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:22:33.801873 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:22:33.801873 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 21:22:33.801873 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Jul 25 21:22:33.809695 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 307/594] 10.222.0.66 () {56 vars in 1102 bytes} [Mon Jul 25 21:22:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:22:33.810796 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0e9c0c-0089-4c5b-9ee6-805376377b28 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:33.821835 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b58a2a4-e74e-45d7-9c53-41ce6778af3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:33.822522 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b58a2a4-e74e-45d7-9c53-41ce6778af3f None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:33.822800 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b58a2a4-e74e-45d7-9c53-41ce6778af3f None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:33.823072 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b58a2a4-e74e-45d7-9c53-41ce6778af3f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:33.895888 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b58a2a4-e74e-45d7-9c53-41ce6778af3f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:33.897384 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b58a2a4-e74e-45d7-9c53-41ce6778af3f None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:33.918372 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0e9c0c-0089-4c5b-9ee6-805376377b28 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:33.951928 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:33.961484 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8358a391-17d3-4956-98c5-9210c1cc1082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:33.962615 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8358a391-17d3-4956-98c5-9210c1cc1082 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:33.963669 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8358a391-17d3-4956-98c5-9210c1cc1082 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:33.964139 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8358a391-17d3-4956-98c5-9210c1cc1082 None admin] PATH_INFO: `/v3/roles` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:33.965228 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8358a391-17d3-4956-98c5-9210c1cc1082 None admin] RBAC: Adding query filter params (name=service) {{(pid=87209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:33.965715 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8358a391-17d3-4956-98c5-9210c1cc1082 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:33.967545 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8358a391-17d3-4956-98c5-9210c1cc1082 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:33.987360 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 308/595] 10.222.0.66 () {56 vars in 1103 bytes} [Mon Jul 25 21:22:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:33.988731 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8358a391-17d3-4956-98c5-9210c1cc1082 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:34.008094 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 288/596] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Jul 25 21:22:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 21:22:34.019289 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b58a2a4-e74e-45d7-9c53-41ce6778af3f None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:34.032387 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:34.114785 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8358a391-17d3-4956-98c5-9210c1cc1082 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:34.141937 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b58a2a4-e74e-45d7-9c53-41ce6778af3f None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:34.152166 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5a56dd-a475-4488-91a1-92914c208147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:34.153138 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5a56dd-a475-4488-91a1-92914c208147 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:34.153556 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5a56dd-a475-4488-91a1-92914c208147 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:34.154030 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5a56dd-a475-4488-91a1-92914c208147 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:34.166334 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5a56dd-a475-4488-91a1-92914c208147 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:34.168215 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5a56dd-a475-4488-91a1-92914c208147 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:34.179386 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0badca0-30c0-4cb0-9870-a5fd35e8b697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:34.179983 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0badca0-30c0-4cb0-9870-a5fd35e8b697 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:34.180258 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0badca0-30c0-4cb0-9870-a5fd35e8b697 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:34.180525 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0badca0-30c0-4cb0-9870-a5fd35e8b697 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:34.185615 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application [None req-9a5a56dd-a475-4488-91a1-92914c208147 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:22:34.185615 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:22:34.185615 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:22:34.185615 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:22:34.185615 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:22:34.185615 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:22:34.185615 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:22:34.185615 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:22:34.185615 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:22:34.185615 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:22:34.185615 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:22:34.185615 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:22:34.185615 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:22:34.185615 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:22:34.185615 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:22:34.186677 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:22:34.186677 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:22:34.186677 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:22:34.186677 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:22:34.186677 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:22:34.186677 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:22:34.186677 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:22:34.186677 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:22:34.186677 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application with Lock( Jul 25 21:22:34.186677 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:22:34.186677 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:22:34.186677 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:22:34.186677 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:22:34.186677 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:22:34.186677 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:22:34.186677 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:22:34.186677 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:22:34.187737 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:22:34.187737 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:22:34.187737 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:22:34.187737 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Jul 25 21:22:34.194283 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0badca0-30c0-4cb0-9870-a5fd35e8b697 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:34.194283 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0badca0-30c0-4cb0-9870-a5fd35e8b697 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:34.194862 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 309/597] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 25 21:22:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:22:34.196079 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5a56dd-a475-4488-91a1-92914c208147 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:34.210409 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application [None req-a0badca0-30c0-4cb0-9870-a5fd35e8b697 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:22:34.210409 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:22:34.210409 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:22:34.210409 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:22:34.210409 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:22:34.210409 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:22:34.210409 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:22:34.210409 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:22:34.210409 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:22:34.210409 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:22:34.210409 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:22:34.210409 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:22:34.210409 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:22:34.210409 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:22:34.210409 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:22:34.211531 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:22:34.211531 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:22:34.211531 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:22:34.211531 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:22:34.211531 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:22:34.211531 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:22:34.211531 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:22:34.211531 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:22:34.211531 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application with Lock( Jul 25 21:22:34.211531 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:22:34.211531 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:22:34.211531 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:22:34.211531 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:22:34.211531 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:22:34.211531 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:22:34.211531 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:22:34.211531 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:22:34.212438 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:22:34.212438 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:22:34.212438 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:22:34.212438 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Jul 25 21:22:34.212438 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 289/598] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 25 21:22:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:22:34.217329 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0badca0-30c0-4cb0-9870-a5fd35e8b697 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:34.257513 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:34.286561 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:34.321537 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5a56dd-a475-4488-91a1-92914c208147 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:34.329879 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0badca0-30c0-4cb0-9870-a5fd35e8b697 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:34.358500 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edf6b3b-dbfb-4afb-bb55-d426d798cae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:34.359588 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edf6b3b-dbfb-4afb-bb55-d426d798cae6 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:34.360103 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edf6b3b-dbfb-4afb-bb55-d426d798cae6 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:34.360586 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edf6b3b-dbfb-4afb-bb55-d426d798cae6 None admin] PATH_INFO: `/v3/domains` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:34.361561 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edf6b3b-dbfb-4afb-bb55-d426d798cae6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:34.362142 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edf6b3b-dbfb-4afb-bb55-d426d798cae6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:34.363878 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edf6b3b-dbfb-4afb-bb55-d426d798cae6 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:34.364806 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076b9fc2-bf1a-44db-a46b-65a986641710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:34.365485 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076b9fc2-bf1a-44db-a46b-65a986641710 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:34.365767 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076b9fc2-bf1a-44db-a46b-65a986641710 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:34.366039 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076b9fc2-bf1a-44db-a46b-65a986641710 None admin] PATH_INFO: `/v3/domains` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:34.366730 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076b9fc2-bf1a-44db-a46b-65a986641710 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:34.367034 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076b9fc2-bf1a-44db-a46b-65a986641710 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:34.368399 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076b9fc2-bf1a-44db-a46b-65a986641710 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:34.383203 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 310/600] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Jul 25 21:22:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:34.384442 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edf6b3b-dbfb-4afb-bb55-d426d798cae6 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:34.385787 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 290/600] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Jul 25 21:22:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:34.387064 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076b9fc2-bf1a-44db-a46b-65a986641710 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:34.486993 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edf6b3b-dbfb-4afb-bb55-d426d798cae6 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:34.488185 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076b9fc2-bf1a-44db-a46b-65a986641710 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:34.494680 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:34.510950 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:34.522463 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2c46ef-6722-4f2a-8b2d-84fd615af1a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:34.523109 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2c46ef-6722-4f2a-8b2d-84fd615af1a7 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:34.523392 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2c46ef-6722-4f2a-8b2d-84fd615af1a7 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:34.523662 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2c46ef-6722-4f2a-8b2d-84fd615af1a7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:34.523854 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03641b9d-20ce-48de-a0ca-7267ba7e89e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:34.524511 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03641b9d-20ce-48de-a0ca-7267ba7e89e6 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:34.524789 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03641b9d-20ce-48de-a0ca-7267ba7e89e6 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:34.525058 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03641b9d-20ce-48de-a0ca-7267ba7e89e6 None admin] PATH_INFO: `/v3/users/glance` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:34.530391 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2c46ef-6722-4f2a-8b2d-84fd615af1a7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:34.531917 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2c46ef-6722-4f2a-8b2d-84fd615af1a7 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:34.532182 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03641b9d-20ce-48de-a0ca-7267ba7e89e6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:34.533882 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03641b9d-20ce-48de-a0ca-7267ba7e89e6 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:34.543492 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application [None req-2f2c46ef-6722-4f2a-8b2d-84fd615af1a7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:22:34.543492 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:22:34.543492 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:22:34.543492 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:22:34.543492 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:22:34.543492 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:22:34.543492 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:22:34.543492 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:22:34.543492 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:22:34.543492 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:22:34.543492 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:22:34.543492 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:22:34.543492 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 21:22:34.543492 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 21:22:34.543492 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 21:22:34.544392 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 21:22:34.544392 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:22:34.544392 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:22:34.544392 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:22:34.544392 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:22:34.544392 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:22:34.544392 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:22:34.544392 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:22:34.544392 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application with Lock( Jul 25 21:22:34.544392 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:22:34.544392 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:22:34.544392 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:22:34.544392 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:22:34.544392 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:22:34.544392 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:22:34.544392 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:22:34.544392 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:22:34.545334 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 21:22:34.545334 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 21:22:34.545334 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 21:22:34.545334 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 21:22:34.545334 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 21:22:34.545334 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 21:22:34.545334 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:22:34.545334 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Jul 25 21:22:34.545963 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application [None req-03641b9d-20ce-48de-a0ca-7267ba7e89e6 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 25 21:22:34.545963 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:22:34.545963 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:22:34.545963 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:22:34.545963 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:22:34.545963 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:22:34.545963 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:22:34.545963 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:22:34.545963 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:22:34.545963 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:22:34.545963 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:22:34.545963 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:22:34.545963 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 21:22:34.545963 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 21:22:34.545963 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 21:22:34.545963 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 21:22:34.546834 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:22:34.546834 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:22:34.546834 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 21:22:34.546834 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:22:34.546834 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 21:22:34.546834 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:22:34.546834 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:22:34.546834 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:22:34.546834 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:22:34.546834 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:22:34.546834 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:22:34.546834 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application with Lock( Jul 25 21:22:34.546834 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:22:34.546834 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:22:34.546834 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:22:34.546834 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:22:34.546834 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:22:34.546834 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:22:34.547790 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:22:34.547790 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:22:34.547790 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 21:22:34.547790 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 21:22:34.547790 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 21:22:34.547790 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 21:22:34.547790 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 21:22:34.547790 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 21:22:34.547790 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 25 21:22:34.547790 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Jul 25 21:22:34.547790 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 311/601] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Jul 25 21:22:34 2022] GET /identity/v3/users/glance => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:22:34.548381 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e869615-401c-4554-b4d1-4a4ac5b3b385 None None] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:34.549447 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e869615-401c-4554-b4d1-4a4ac5b3b385 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:34.549447 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e869615-401c-4554-b4d1-4a4ac5b3b385 None None] PATH_INFO: `/` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:34.550098 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 291/602] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Jul 25 21:22:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 21:22:34.550797 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 312/603] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:22:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:22:34.551498 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e869615-401c-4554-b4d1-4a4ac5b3b385 None None] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:34.552114 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85503187-0b4e-4d62-aaab-6afee7dca38b None None] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:34.552404 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85503187-0b4e-4d62-aaab-6afee7dca38b None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:34.552684 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85503187-0b4e-4d62-aaab-6afee7dca38b None None] PATH_INFO: `/` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:34.554196 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 292/604] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:22:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:22:34.554854 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85503187-0b4e-4d62-aaab-6afee7dca38b None None] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:34.655464 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e869615-401c-4554-b4d1-4a4ac5b3b385 None None] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:34.657611 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85503187-0b4e-4d62-aaab-6afee7dca38b None None] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:34.694080 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d4d857-c9e9-4ca4-b006-cfc46188ccd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:34.694711 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d4d857-c9e9-4ca4-b006-cfc46188ccd5 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:34.694989 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d4d857-c9e9-4ca4-b006-cfc46188ccd5 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:34.695087 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad46c5fd-8c6f-4560-a2b8-2e3ec7cf8215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:34.695260 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d4d857-c9e9-4ca4-b006-cfc46188ccd5 None admin] PATH_INFO: `/v3/projects` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:34.695620 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad46c5fd-8c6f-4560-a2b8-2e3ec7cf8215 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:34.695900 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad46c5fd-8c6f-4560-a2b8-2e3ec7cf8215 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:34.696012 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d4d857-c9e9-4ca4-b006-cfc46188ccd5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:34.696271 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad46c5fd-8c6f-4560-a2b8-2e3ec7cf8215 None admin] PATH_INFO: `/v3/users` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:34.696369 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d4d857-c9e9-4ca4-b006-cfc46188ccd5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:34.697070 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad46c5fd-8c6f-4560-a2b8-2e3ec7cf8215 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:34.697410 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad46c5fd-8c6f-4560-a2b8-2e3ec7cf8215 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:34.697758 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d4d857-c9e9-4ca4-b006-cfc46188ccd5 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:34.698826 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad46c5fd-8c6f-4560-a2b8-2e3ec7cf8215 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:34.710027 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 313/605] 10.222.0.66 () {56 vars in 1148 bytes} [Mon Jul 25 21:22:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:34.711371 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f7f88d-bb04-477f-bf72-3516a60f6ebb None None] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:34.711660 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f7f88d-bb04-477f-bf72-3516a60f6ebb None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:34.711940 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f7f88d-bb04-477f-bf72-3516a60f6ebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:34.717126 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 293/606] 10.222.0.66 () {56 vars in 1137 bytes} [Mon Jul 25 21:22:34 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:34.717780 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61c646c-b6d9-4687-af72-55039a7a05de None None] REQUEST_METHOD: `POST` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:34.718061 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61c646c-b6d9-4687-af72-55039a7a05de None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:34.718515 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61c646c-b6d9-4687-af72-55039a7a05de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:34.730499 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.auth.core [None req-d5f7f88d-bb04-477f-bf72-3516a60f6ebb None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:22:34.731700 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-d5f7f88d-bb04-477f-bf72-3516a60f6ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:22:34.737585 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.auth.core [None req-d61c646c-b6d9-4687-af72-55039a7a05de None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:22:34.738694 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.fernet_utils [None req-d61c646c-b6d9-4687-af72-55039a7a05de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:22:34.752914 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:34.773593 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:34.800591 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 314/607] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:22:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:22:34.801565 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f7f88d-bb04-477f-bf72-3516a60f6ebb None None] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:34.807141 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 294/608] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:22:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:22:34.807963 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61c646c-b6d9-4687-af72-55039a7a05de None None] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:34.912553 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61c646c-b6d9-4687-af72-55039a7a05de None None] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:34.914157 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f7f88d-bb04-477f-bf72-3516a60f6ebb None None] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:34.946103 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907583bc-118b-4898-98c2-ab6f007e5b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:34.946742 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907583bc-118b-4898-98c2-ab6f007e5b6e None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:34.947027 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907583bc-118b-4898-98c2-ab6f007e5b6e None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:34.947656 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907583bc-118b-4898-98c2-ab6f007e5b6e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:34.951584 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d69ee2-4a77-4754-9159-9ec7034d646c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:34.952202 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d69ee2-4a77-4754-9159-9ec7034d646c None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:34.952476 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d69ee2-4a77-4754-9159-9ec7034d646c None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:34.952742 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d69ee2-4a77-4754-9159-9ec7034d646c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:34.953548 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d69ee2-4a77-4754-9159-9ec7034d646c None admin] RBAC: Adding query filter params (role.id=a3f3fbd04ac04f888e9d384179040765, scope.project.id=7e36d923af474a07adb12209580f12e1, user.id=524584f0d1b64e02a467b47de395c130) {{(pid=87209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:34.953863 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d69ee2-4a77-4754-9159-9ec7034d646c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:34.955595 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d69ee2-4a77-4754-9159-9ec7034d646c None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:34.963952 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 315/609] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Jul 25 21:22:34 2022] GET /identity/v3/role_assignments?user.id=524584f0d1b64e02a467b47de395c130&scope.project.id=7e36d923af474a07adb12209580f12e1&role.id=a3f3fbd04ac04f888e9d384179040765 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:34.964792 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d69ee2-4a77-4754-9159-9ec7034d646c None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:34.990919 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:35.008524 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:35.027494 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907583bc-118b-4898-98c2-ab6f007e5b6e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:35.029597 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907583bc-118b-4898-98c2-ab6f007e5b6e None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:35.096352 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d69ee2-4a77-4754-9159-9ec7034d646c None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:35.135963 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e43f8a-3319-4327-865b-8d9625796d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:35.136947 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e43f8a-3319-4327-865b-8d9625796d4f None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:35.137257 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e43f8a-3319-4327-865b-8d9625796d4f None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:35.137539 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e43f8a-3319-4327-865b-8d9625796d4f None admin] PATH_INFO: `/v3/roles/service` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:35.149689 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e43f8a-3319-4327-865b-8d9625796d4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:22:35.155070 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application [None req-23e43f8a-3319-4327-865b-8d9625796d4f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 21:22:35.155070 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:22:35.155070 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:22:35.155070 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:22:35.155070 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:22:35.155070 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:22:35.155070 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:22:35.155070 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:22:35.155070 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:22:35.155070 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:22:35.155070 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:22:35.155070 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:22:35.155070 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:22:35.155070 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:22:35.155070 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:22:35.155070 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:22:35.155970 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:22:35.155970 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:22:35.155970 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:22:35.155970 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:22:35.155970 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:22:35.155970 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:22:35.155970 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:22:35.155970 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:22:35.155970 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:22:35.155970 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:22:35.155970 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:22:35.155970 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application with Lock( Jul 25 21:22:35.155970 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:22:35.155970 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:22:35.155970 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:22:35.155970 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:22:35.156788 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:22:35.156788 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:22:35.156788 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:22:35.156788 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:22:35.156788 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:22:35.156788 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:22:35.156788 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:22:35.156788 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:22:35.156788 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:22:35.156788 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:22:35.156788 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 21:22:35.156788 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Jul 25 21:22:35.156788 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 316/610] 10.222.0.66 () {56 vars in 1102 bytes} [Mon Jul 25 21:22:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:22:35.157636 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e43f8a-3319-4327-865b-8d9625796d4f None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:35.162120 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 295/611] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Jul 25 21:22:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 21:22:35.162966 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907583bc-118b-4898-98c2-ab6f007e5b6e None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:35.242634 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:35.254288 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:35.275783 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907583bc-118b-4898-98c2-ab6f007e5b6e None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:35.275968 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e43f8a-3319-4327-865b-8d9625796d4f None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:35.310686 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20bee8f-072d-48d3-8a17-2370a5342a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:35.311338 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20bee8f-072d-48d3-8a17-2370a5342a51 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:35.311594 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20bee8f-072d-48d3-8a17-2370a5342a51 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:35.311864 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20bee8f-072d-48d3-8a17-2370a5342a51 None admin] PATH_INFO: `/v3/roles` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:35.312576 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20bee8f-072d-48d3-8a17-2370a5342a51 None admin] RBAC: Adding query filter params (name=service) {{(pid=87210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:35.312876 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20bee8f-072d-48d3-8a17-2370a5342a51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:35.314348 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20bee8f-072d-48d3-8a17-2370a5342a51 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:35.314950 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a031306e-30bd-4478-b5f5-cccb9c96e8f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:35.315796 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a031306e-30bd-4478-b5f5-cccb9c96e8f5 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:35.316267 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a031306e-30bd-4478-b5f5-cccb9c96e8f5 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:35.316717 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a031306e-30bd-4478-b5f5-cccb9c96e8f5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:35.322824 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 296/612] 10.222.0.66 () {56 vars in 1103 bytes} [Mon Jul 25 21:22:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:35.323833 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20bee8f-072d-48d3-8a17-2370a5342a51 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:35.332759 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a031306e-30bd-4478-b5f5-cccb9c96e8f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:22:35.338514 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application [None req-a031306e-30bd-4478-b5f5-cccb9c96e8f5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 21:22:35.338514 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:22:35.338514 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:22:35.338514 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:22:35.338514 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:22:35.338514 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:22:35.338514 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:22:35.338514 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:22:35.338514 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:22:35.338514 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:22:35.338514 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:22:35.338514 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:22:35.338514 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:22:35.338514 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:22:35.338514 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:22:35.338514 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:22:35.339440 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:22:35.339440 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:22:35.339440 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:22:35.339440 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:22:35.339440 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:22:35.339440 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:22:35.339440 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:22:35.339440 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:22:35.339440 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:22:35.339440 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:22:35.339440 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:22:35.339440 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application with Lock( Jul 25 21:22:35.339440 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:22:35.339440 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:22:35.339440 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:22:35.339440 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:22:35.340347 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:22:35.340347 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:22:35.340347 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:22:35.340347 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:22:35.340347 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:22:35.340347 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:22:35.340347 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:22:35.340347 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:22:35.340347 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:22:35.340347 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:22:35.340347 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 21:22:35.340347 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Jul 25 21:22:35.346396 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 317/613] 10.222.0.66 () {56 vars in 1102 bytes} [Mon Jul 25 21:22:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:22:35.346396 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a031306e-30bd-4478-b5f5-cccb9c96e8f5 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:35.430807 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20bee8f-072d-48d3-8a17-2370a5342a51 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:35.456787 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a031306e-30bd-4478-b5f5-cccb9c96e8f5 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:35.462360 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:35.469257 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a8f1d8-ad77-415f-8d80-57160aaf66a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:35.470485 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a8f1d8-ad77-415f-8d80-57160aaf66a5 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:35.471144 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a8f1d8-ad77-415f-8d80-57160aaf66a5 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:35.471414 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a8f1d8-ad77-415f-8d80-57160aaf66a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:35.485716 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a8f1d8-ad77-415f-8d80-57160aaf66a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:35.487504 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a8f1d8-ad77-415f-8d80-57160aaf66a5 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:35.491991 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fc61b7-acc4-4b7c-81bc-00b31f570a52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:35.492696 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fc61b7-acc4-4b7c-81bc-00b31f570a52 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:35.492920 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fc61b7-acc4-4b7c-81bc-00b31f570a52 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:35.493262 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fc61b7-acc4-4b7c-81bc-00b31f570a52 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:35.503085 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:35.504319 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application [None req-16a8f1d8-ad77-415f-8d80-57160aaf66a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:22:35.504319 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:22:35.504319 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:22:35.504319 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:22:35.504319 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:22:35.504319 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:22:35.504319 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:22:35.504319 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:22:35.504319 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:22:35.504319 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:22:35.504319 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:22:35.504319 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:22:35.504319 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:22:35.504319 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:22:35.504319 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:22:35.505686 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:22:35.505686 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:22:35.505686 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:22:35.505686 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:22:35.505686 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:22:35.505686 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:22:35.505686 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:22:35.505686 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:22:35.505686 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application with Lock( Jul 25 21:22:35.505686 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:22:35.505686 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:22:35.505686 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:22:35.505686 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:22:35.505686 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:22:35.505686 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:22:35.505686 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:22:35.505686 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:22:35.506677 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:22:35.506677 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:22:35.506677 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:22:35.506677 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Jul 25 21:22:35.506677 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 297/614] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 25 21:22:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:22:35.508380 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fc61b7-acc4-4b7c-81bc-00b31f570a52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:35.508730 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a8f1d8-ad77-415f-8d80-57160aaf66a5 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:35.510234 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fc61b7-acc4-4b7c-81bc-00b31f570a52 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:35.525275 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application [None req-d2fc61b7-acc4-4b7c-81bc-00b31f570a52 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:22:35.525275 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:22:35.525275 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:22:35.525275 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:22:35.525275 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:22:35.525275 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:22:35.525275 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:22:35.525275 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:22:35.525275 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:22:35.525275 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:22:35.525275 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:22:35.525275 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:22:35.525275 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:22:35.525275 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:22:35.525275 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:22:35.528103 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:22:35.528103 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:22:35.528103 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:22:35.528103 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:22:35.528103 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:22:35.528103 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:22:35.528103 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:22:35.528103 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:22:35.528103 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application with Lock( Jul 25 21:22:35.528103 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:22:35.528103 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:22:35.528103 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:22:35.528103 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:22:35.528103 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:22:35.528103 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:22:35.528103 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:22:35.528103 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:22:35.529012 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:22:35.529012 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:22:35.529012 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:22:35.529012 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Jul 25 21:22:35.529012 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 318/615] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 25 21:22:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:22:35.529012 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fc61b7-acc4-4b7c-81bc-00b31f570a52 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:35.621048 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a8f1d8-ad77-415f-8d80-57160aaf66a5 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:35.635618 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fc61b7-acc4-4b7c-81bc-00b31f570a52 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:35.655019 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1323beb5-c0fc-44f7-895b-fd302fb339c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:35.655645 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1323beb5-c0fc-44f7-895b-fd302fb339c4 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:35.655924 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1323beb5-c0fc-44f7-895b-fd302fb339c4 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:35.656203 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1323beb5-c0fc-44f7-895b-fd302fb339c4 None admin] PATH_INFO: `/v3/roles` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:35.656925 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1323beb5-c0fc-44f7-895b-fd302fb339c4 None admin] RBAC: Adding query filter params (name=service) {{(pid=87210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:35.657256 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1323beb5-c0fc-44f7-895b-fd302fb339c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:35.658674 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1323beb5-c0fc-44f7-895b-fd302fb339c4 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:35.666910 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 298/616] 10.222.0.66 () {56 vars in 1103 bytes} [Mon Jul 25 21:22:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:35.667699 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1323beb5-c0fc-44f7-895b-fd302fb339c4 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:35.676911 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2c0709-a046-477d-84d3-da61dfe85972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:35.677924 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2c0709-a046-477d-84d3-da61dfe85972 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:35.678201 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2c0709-a046-477d-84d3-da61dfe85972 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:35.678501 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2c0709-a046-477d-84d3-da61dfe85972 None admin] PATH_INFO: `/v3/domains` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:35.679181 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2c0709-a046-477d-84d3-da61dfe85972 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:35.679478 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2c0709-a046-477d-84d3-da61dfe85972 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:35.680961 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2c0709-a046-477d-84d3-da61dfe85972 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:35.694114 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 319/617] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Jul 25 21:22:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:35.694937 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2c0709-a046-477d-84d3-da61dfe85972 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:35.722608 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:35.758737 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:35.782820 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1323beb5-c0fc-44f7-895b-fd302fb339c4 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:35.816619 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d07e2c-8617-4a73-bed2-46bdc79e2fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:35.817271 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d07e2c-8617-4a73-bed2-46bdc79e2fa1 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:35.817547 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d07e2c-8617-4a73-bed2-46bdc79e2fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:35.817816 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d07e2c-8617-4a73-bed2-46bdc79e2fa1 None admin] PATH_INFO: `/v3/domains` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:35.818503 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d07e2c-8617-4a73-bed2-46bdc79e2fa1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:35.818802 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d07e2c-8617-4a73-bed2-46bdc79e2fa1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:35.819582 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2c0709-a046-477d-84d3-da61dfe85972 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:35.820168 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d07e2c-8617-4a73-bed2-46bdc79e2fa1 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:35.834606 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 299/618] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Jul 25 21:22:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:35.835444 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d07e2c-8617-4a73-bed2-46bdc79e2fa1 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:35.861914 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d710f5-4eaf-4fda-9c3e-a97f7813c952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:35.862578 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d710f5-4eaf-4fda-9c3e-a97f7813c952 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:35.862898 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d710f5-4eaf-4fda-9c3e-a97f7813c952 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:35.863300 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d710f5-4eaf-4fda-9c3e-a97f7813c952 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:35.875196 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d710f5-4eaf-4fda-9c3e-a97f7813c952 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:35.876659 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d710f5-4eaf-4fda-9c3e-a97f7813c952 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:35.892144 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application [None req-16d710f5-4eaf-4fda-9c3e-a97f7813c952 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:22:35.892144 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:22:35.892144 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:22:35.892144 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:22:35.892144 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:22:35.892144 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:22:35.892144 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:22:35.892144 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:22:35.892144 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:22:35.892144 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:22:35.892144 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:22:35.892144 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:22:35.892144 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:22:35.892144 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:22:35.892144 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:22:35.893375 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:22:35.893375 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:22:35.893375 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:22:35.893375 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:22:35.893375 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:22:35.893375 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:22:35.893375 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:22:35.893375 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:22:35.893375 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application with Lock( Jul 25 21:22:35.893375 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:22:35.893375 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:22:35.893375 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:22:35.893375 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:22:35.893375 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:22:35.893375 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:22:35.893375 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:22:35.893375 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:22:35.899137 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:22:35.899137 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:22:35.899137 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:22:35.899137 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Jul 25 21:22:35.899137 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 320/619] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 25 21:22:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:22:35.899137 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d710f5-4eaf-4fda-9c3e-a97f7813c952 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:35.952725 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d07e2c-8617-4a73-bed2-46bdc79e2fa1 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:35.961062 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:35.992214 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caafc37-d786-4b59-9c65-6b66dab4f0ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:35.993195 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caafc37-d786-4b59-9c65-6b66dab4f0ef None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:35.993473 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caafc37-d786-4b59-9c65-6b66dab4f0ef None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:35.993744 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caafc37-d786-4b59-9c65-6b66dab4f0ef None admin] PATH_INFO: `/v3/projects/service` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:36.001173 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caafc37-d786-4b59-9c65-6b66dab4f0ef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:36.003263 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caafc37-d786-4b59-9c65-6b66dab4f0ef None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:36.014056 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d710f5-4eaf-4fda-9c3e-a97f7813c952 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:36.014768 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application [None req-7caafc37-d786-4b59-9c65-6b66dab4f0ef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:22:36.014768 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:22:36.014768 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:22:36.014768 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:22:36.014768 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:22:36.014768 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:22:36.014768 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:22:36.014768 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:22:36.014768 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:22:36.014768 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:22:36.014768 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:22:36.014768 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:22:36.014768 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 21:22:36.014768 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 21:22:36.014768 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 21:22:36.015597 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 21:22:36.015597 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:22:36.015597 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:22:36.015597 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:22:36.015597 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:22:36.015597 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:22:36.015597 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:22:36.015597 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:22:36.015597 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application with Lock( Jul 25 21:22:36.015597 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:22:36.015597 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:22:36.015597 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:22:36.015597 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:22:36.015597 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:22:36.015597 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:22:36.015597 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:22:36.015597 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:22:36.016686 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 21:22:36.016686 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 21:22:36.016686 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 21:22:36.016686 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 21:22:36.016686 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 21:22:36.016686 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 21:22:36.016686 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:22:36.016686 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Jul 25 21:22:36.016686 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 300/620] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Jul 25 21:22:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:22:36.017193 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caafc37-d786-4b59-9c65-6b66dab4f0ef None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:36.022859 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:36.061926 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e8d827-0d7f-4ee5-a08f-4a551e08c0bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:36.062587 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e8d827-0d7f-4ee5-a08f-4a551e08c0bf None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:36.062860 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e8d827-0d7f-4ee5-a08f-4a551e08c0bf None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:36.063130 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e8d827-0d7f-4ee5-a08f-4a551e08c0bf None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:36.071357 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e8d827-0d7f-4ee5-a08f-4a551e08c0bf None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:36.072812 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e8d827-0d7f-4ee5-a08f-4a551e08c0bf None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:36.084681 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application [None req-e9e8d827-0d7f-4ee5-a08f-4a551e08c0bf None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 21:22:36.084681 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:22:36.084681 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:22:36.084681 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:22:36.084681 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:22:36.084681 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:22:36.084681 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:22:36.084681 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:22:36.084681 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:22:36.084681 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:22:36.084681 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:22:36.084681 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:22:36.084681 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 21:22:36.084681 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 21:22:36.084681 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 21:22:36.084681 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 21:22:36.085765 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:22:36.085765 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:22:36.085765 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 21:22:36.085765 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:22:36.085765 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 21:22:36.085765 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:22:36.085765 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:22:36.085765 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:22:36.085765 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:22:36.085765 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:22:36.085765 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:22:36.085765 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application with Lock( Jul 25 21:22:36.085765 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:22:36.085765 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:22:36.085765 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:22:36.085765 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:22:36.085765 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:22:36.085765 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:22:36.086867 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:22:36.086867 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:22:36.086867 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 21:22:36.086867 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 21:22:36.086867 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 21:22:36.086867 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 21:22:36.086867 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 21:22:36.086867 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 21:22:36.086867 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 21:22:36.086867 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Jul 25 21:22:36.086867 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 321/621] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Jul 25 21:22:35 2022] GET /identity/v3/users/cinder => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:22:36.086867 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e8d827-0d7f-4ee5-a08f-4a551e08c0bf None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:36.137743 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caafc37-d786-4b59-9c65-6b66dab4f0ef None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:36.175189 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d686b0-8bad-4831-a210-38129521dc8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:36.176272 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d686b0-8bad-4831-a210-38129521dc8d None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:36.176553 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d686b0-8bad-4831-a210-38129521dc8d None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:36.177139 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d686b0-8bad-4831-a210-38129521dc8d None admin] PATH_INFO: `/v3/domains` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:36.177869 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d686b0-8bad-4831-a210-38129521dc8d None admin] RBAC: Adding query filter params (name=Default) {{(pid=87210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:36.178176 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d686b0-8bad-4831-a210-38129521dc8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:36.180422 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d686b0-8bad-4831-a210-38129521dc8d None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:36.197858 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 301/622] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Jul 25 21:22:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:36.198718 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d686b0-8bad-4831-a210-38129521dc8d None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:36.200100 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e8d827-0d7f-4ee5-a08f-4a551e08c0bf None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:36.228738 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:36.239228 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5048782f-084d-4116-a863-415960a80621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:36.240042 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5048782f-084d-4116-a863-415960a80621 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:36.241158 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5048782f-084d-4116-a863-415960a80621 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:36.241446 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5048782f-084d-4116-a863-415960a80621 None admin] PATH_INFO: `/v3/projects` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:36.242229 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5048782f-084d-4116-a863-415960a80621 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:36.242519 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5048782f-084d-4116-a863-415960a80621 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:36.243998 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5048782f-084d-4116-a863-415960a80621 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:36.265479 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 322/623] 10.222.0.66 () {56 vars in 1148 bytes} [Mon Jul 25 21:22:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:36.265479 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5048782f-084d-4116-a863-415960a80621 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:36.294536 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:36.314335 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d686b0-8bad-4831-a210-38129521dc8d None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:36.351220 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69436f3-ed1a-4c3f-90de-1e625ca51c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:36.351848 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69436f3-ed1a-4c3f-90de-1e625ca51c68 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:36.352131 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69436f3-ed1a-4c3f-90de-1e625ca51c68 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:36.352406 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69436f3-ed1a-4c3f-90de-1e625ca51c68 None admin] PATH_INFO: `/v3/users` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:36.353232 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69436f3-ed1a-4c3f-90de-1e625ca51c68 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:36.353541 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69436f3-ed1a-4c3f-90de-1e625ca51c68 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:36.354973 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69436f3-ed1a-4c3f-90de-1e625ca51c68 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:36.373586 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5048782f-084d-4116-a863-415960a80621 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:36.377879 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 302/624] 10.222.0.66 () {56 vars in 1137 bytes} [Mon Jul 25 21:22:36 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:36.378787 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69436f3-ed1a-4c3f-90de-1e625ca51c68 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:36.409448 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7c4468-4f43-4e40-835d-e70c6d21b32f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:36.410102 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7c4468-4f43-4e40-835d-e70c6d21b32f None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:36.410383 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7c4468-4f43-4e40-835d-e70c6d21b32f None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:36.410660 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7c4468-4f43-4e40-835d-e70c6d21b32f None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:36.418168 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7c4468-4f43-4e40-835d-e70c6d21b32f None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:36.419642 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7c4468-4f43-4e40-835d-e70c6d21b32f None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:36.432606 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application [None req-fe7c4468-4f43-4e40-835d-e70c6d21b32f None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 25 21:22:36.432606 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:22:36.432606 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:22:36.432606 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:22:36.432606 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:22:36.432606 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:22:36.432606 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:22:36.432606 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:22:36.432606 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:22:36.432606 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:22:36.432606 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:22:36.432606 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:22:36.432606 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 21:22:36.432606 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 21:22:36.432606 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 21:22:36.432606 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 21:22:36.433694 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:22:36.433694 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:22:36.433694 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 21:22:36.433694 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:22:36.433694 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 21:22:36.433694 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:22:36.433694 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:22:36.433694 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:22:36.433694 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:22:36.433694 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:22:36.433694 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:22:36.433694 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application with Lock( Jul 25 21:22:36.433694 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:22:36.433694 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:22:36.433694 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:22:36.433694 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:22:36.433694 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:22:36.433694 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:22:36.434837 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:22:36.434837 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:22:36.434837 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 21:22:36.434837 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 21:22:36.434837 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 21:22:36.434837 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 21:22:36.434837 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 21:22:36.434837 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 21:22:36.434837 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 25 21:22:36.434837 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Jul 25 21:22:36.438342 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 323/625] 10.222.0.66 () {56 vars in 1102 bytes} [Mon Jul 25 21:22:36 2022] GET /identity/v3/users/neutron => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:22:36.439165 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7c4468-4f43-4e40-835d-e70c6d21b32f None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:36.489778 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:36.516159 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69436f3-ed1a-4c3f-90de-1e625ca51c68 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:36.551055 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:36.556067 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfe7146-ec10-47fa-8fe9-5d4dd8e451a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:36.556871 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfe7146-ec10-47fa-8fe9-5d4dd8e451a5 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:36.557710 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfe7146-ec10-47fa-8fe9-5d4dd8e451a5 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:36.557941 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfe7146-ec10-47fa-8fe9-5d4dd8e451a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:36.559173 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfe7146-ec10-47fa-8fe9-5d4dd8e451a5 None admin] RBAC: Adding query filter params (role.id=a3f3fbd04ac04f888e9d384179040765, scope.project.id=7e36d923af474a07adb12209580f12e1, user.id=1b47561e7cd048f79518db147de16c1b) {{(pid=87210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:36.560133 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfe7146-ec10-47fa-8fe9-5d4dd8e451a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:36.562426 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfe7146-ec10-47fa-8fe9-5d4dd8e451a5 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:36.570029 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 303/626] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Jul 25 21:22:36 2022] GET /identity/v3/role_assignments?user.id=1b47561e7cd048f79518db147de16c1b&scope.project.id=7e36d923af474a07adb12209580f12e1&role.id=a3f3fbd04ac04f888e9d384179040765 => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:36.571090 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfe7146-ec10-47fa-8fe9-5d4dd8e451a5 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:36.584454 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7c4468-4f43-4e40-835d-e70c6d21b32f None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:36.644353 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599c80e9-48b1-4a5f-b2d4-9361c8219112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:36.645417 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599c80e9-48b1-4a5f-b2d4-9361c8219112 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:36.645900 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599c80e9-48b1-4a5f-b2d4-9361c8219112 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:36.646356 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599c80e9-48b1-4a5f-b2d4-9361c8219112 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:36.750211 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599c80e9-48b1-4a5f-b2d4-9361c8219112 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:36.755836 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599c80e9-48b1-4a5f-b2d4-9361c8219112 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:36.783587 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfe7146-ec10-47fa-8fe9-5d4dd8e451a5 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:36.832714 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b62aef-e8e3-4f55-aed7-813b1b92f262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:36.833917 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b62aef-e8e3-4f55-aed7-813b1b92f262 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:36.834227 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b62aef-e8e3-4f55-aed7-813b1b92f262 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:36.834696 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b62aef-e8e3-4f55-aed7-813b1b92f262 None admin] PATH_INFO: `/v3/users` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:36.836463 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b62aef-e8e3-4f55-aed7-813b1b92f262 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:36.836463 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b62aef-e8e3-4f55-aed7-813b1b92f262 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:36.837278 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b62aef-e8e3-4f55-aed7-813b1b92f262 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:36.865485 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 304/627] 10.222.0.66 () {56 vars in 1139 bytes} [Mon Jul 25 21:22:36 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:36.867564 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b62aef-e8e3-4f55-aed7-813b1b92f262 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:36.871676 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:36.879896 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:36.901154 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 324/628] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Jul 25 21:22:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 21:22:36.903629 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599c80e9-48b1-4a5f-b2d4-9361c8219112 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:37.016093 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b62aef-e8e3-4f55-aed7-813b1b92f262 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:37.057429 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a705cc-3ea9-4bbc-8738-e51d25d8ef14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:37.057990 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a705cc-3ea9-4bbc-8738-e51d25d8ef14 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:37.058271 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a705cc-3ea9-4bbc-8738-e51d25d8ef14 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:37.058546 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a705cc-3ea9-4bbc-8738-e51d25d8ef14 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:37.092653 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599c80e9-48b1-4a5f-b2d4-9361c8219112 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:37.139444 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedc8e61-879c-469f-b1f3-9220aff779de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:37.140936 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedc8e61-879c-469f-b1f3-9220aff779de None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:37.141431 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedc8e61-879c-469f-b1f3-9220aff779de None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:37.142082 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedc8e61-879c-469f-b1f3-9220aff779de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:37.147342 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a705cc-3ea9-4bbc-8738-e51d25d8ef14 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:37.148740 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a705cc-3ea9-4bbc-8738-e51d25d8ef14 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:37.160026 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:37.162913 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedc8e61-879c-469f-b1f3-9220aff779de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:37.165007 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedc8e61-879c-469f-b1f3-9220aff779de None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:37.186322 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application [None req-aedc8e61-879c-469f-b1f3-9220aff779de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:22:37.186322 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:22:37.186322 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:22:37.186322 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:22:37.186322 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:22:37.186322 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:22:37.186322 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:22:37.186322 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:22:37.186322 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:22:37.186322 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:22:37.186322 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:22:37.186322 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:22:37.186322 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:22:37.186322 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:22:37.186322 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:22:37.187303 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:22:37.187303 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:22:37.187303 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:22:37.187303 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:22:37.187303 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:22:37.187303 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:22:37.187303 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:22:37.187303 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:22:37.187303 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application with Lock( Jul 25 21:22:37.187303 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:22:37.187303 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:22:37.187303 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:22:37.187303 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:22:37.187303 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:22:37.187303 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:22:37.187303 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:22:37.187303 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:22:37.188268 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:22:37.188268 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:22:37.188268 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:22:37.188268 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Jul 25 21:22:37.195237 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 325/629] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 25 21:22:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:22:37.196366 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedc8e61-879c-469f-b1f3-9220aff779de None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:37.247753 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:37.288183 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 305/630] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Jul 25 21:22:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 25 21:22:37.294369 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a705cc-3ea9-4bbc-8738-e51d25d8ef14 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:37.330690 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedc8e61-879c-469f-b1f3-9220aff779de None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:37.366803 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2c8109-196f-45d1-9c38-94fe90834aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:37.367438 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c8109-196f-45d1-9c38-94fe90834aeb None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:37.367721 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c8109-196f-45d1-9c38-94fe90834aeb None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:37.367997 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c8109-196f-45d1-9c38-94fe90834aeb None admin] PATH_INFO: `/v3/domains` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:37.368686 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2c8109-196f-45d1-9c38-94fe90834aeb None admin] RBAC: Adding query filter params (name=Default) {{(pid=87209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:37.368991 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2c8109-196f-45d1-9c38-94fe90834aeb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:37.370418 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2c8109-196f-45d1-9c38-94fe90834aeb None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:37.383147 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 326/631] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Jul 25 21:22:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:37.384355 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fea4be-b859-4988-960f-f764e6c673fe None None] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:37.384632 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fea4be-b859-4988-960f-f764e6c673fe None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:37.384901 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fea4be-b859-4988-960f-f764e6c673fe None None] PATH_INFO: `/` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:37.386287 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 327/632] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:22:37 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:22:37.390576 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fea4be-b859-4988-960f-f764e6c673fe None None] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:37.408024 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a705cc-3ea9-4bbc-8738-e51d25d8ef14 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:37.416709 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:37.447574 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48bbebc-6ad1-4db0-a10d-6311d0d62e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:37.448234 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48bbebc-6ad1-4db0-a10d-6311d0d62e71 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:37.448512 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48bbebc-6ad1-4db0-a10d-6311d0d62e71 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:37.448785 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48bbebc-6ad1-4db0-a10d-6311d0d62e71 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:37.459744 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48bbebc-6ad1-4db0-a10d-6311d0d62e71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:37.461729 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48bbebc-6ad1-4db0-a10d-6311d0d62e71 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:37.476467 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application [None req-c48bbebc-6ad1-4db0-a10d-6311d0d62e71 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:22:37.476467 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:22:37.476467 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:22:37.476467 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:22:37.476467 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:22:37.476467 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:22:37.476467 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:22:37.476467 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:22:37.476467 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:22:37.476467 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:22:37.476467 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:22:37.476467 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:22:37.476467 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:22:37.476467 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:22:37.476467 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:22:37.477483 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:22:37.477483 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:22:37.477483 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:22:37.477483 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:22:37.477483 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:22:37.477483 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:22:37.477483 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:22:37.477483 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:22:37.477483 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application with Lock( Jul 25 21:22:37.477483 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:22:37.477483 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:22:37.477483 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:22:37.477483 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:22:37.477483 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:22:37.477483 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:22:37.477483 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:22:37.477483 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:22:37.478361 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:22:37.478361 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:22:37.478361 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:22:37.478361 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Jul 25 21:22:37.478361 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 306/633] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 25 21:22:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 21:22:37.479439 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153a4d6b-5ea7-422d-8bf4-d0d2e1d0ef95 None None] REQUEST_METHOD: `POST` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:37.479439 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153a4d6b-5ea7-422d-8bf4-d0d2e1d0ef95 None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:37.479439 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153a4d6b-5ea7-422d-8bf4-d0d2e1d0ef95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:37.499466 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:37.500388 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.auth.core [None req-153a4d6b-5ea7-422d-8bf4-d0d2e1d0ef95 None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:22:37.501926 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.fernet_utils [None req-153a4d6b-5ea7-422d-8bf4-d0d2e1d0ef95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:22:37.508212 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fea4be-b859-4988-960f-f764e6c673fe None None] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:37.547229 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8789bd-9fac-48cc-b922-a17dc5f94df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:37.547885 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8789bd-9fac-48cc-b922-a17dc5f94df6 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:37.548158 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8789bd-9fac-48cc-b922-a17dc5f94df6 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:37.548427 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8789bd-9fac-48cc-b922-a17dc5f94df6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:37.555766 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8789bd-9fac-48cc-b922-a17dc5f94df6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:37.557298 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8789bd-9fac-48cc-b922-a17dc5f94df6 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:37.568920 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application [None req-6f8789bd-9fac-48cc-b922-a17dc5f94df6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:22:37.568920 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:22:37.568920 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:22:37.568920 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:22:37.568920 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:22:37.568920 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:22:37.568920 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:22:37.568920 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:22:37.568920 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:22:37.568920 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:22:37.568920 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:22:37.568920 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:22:37.568920 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 21:22:37.568920 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 21:22:37.568920 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 21:22:37.570612 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 21:22:37.570612 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:22:37.570612 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:22:37.570612 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:22:37.570612 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:22:37.570612 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:22:37.570612 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:22:37.570612 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:22:37.570612 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application with Lock( Jul 25 21:22:37.570612 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:22:37.570612 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:22:37.570612 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:22:37.570612 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:22:37.570612 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:22:37.570612 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:22:37.570612 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:22:37.570612 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:22:37.572298 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 21:22:37.572298 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 21:22:37.572298 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 21:22:37.572298 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 21:22:37.572298 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 21:22:37.572298 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 21:22:37.572298 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:22:37.572298 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Jul 25 21:22:37.572298 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 328/634] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Jul 25 21:22:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:22:37.572298 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8789bd-9fac-48cc-b922-a17dc5f94df6 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:37.579353 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 307/635] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:22:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:22:37.580268 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153a4d6b-5ea7-422d-8bf4-d0d2e1d0ef95 None None] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:37.675340 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:37.690079 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153a4d6b-5ea7-422d-8bf4-d0d2e1d0ef95 None None] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:37.708928 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8789bd-9fac-48cc-b922-a17dc5f94df6 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:37.726292 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2225d13-ab73-4529-819e-604cc1e1c817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:37.726926 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2225d13-ab73-4529-819e-604cc1e1c817 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:37.727201 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2225d13-ab73-4529-819e-604cc1e1c817 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:37.727469 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2225d13-ab73-4529-819e-604cc1e1c817 None admin] PATH_INFO: `/v3/projects` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:37.728213 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2225d13-ab73-4529-819e-604cc1e1c817 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:37.728514 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2225d13-ab73-4529-819e-604cc1e1c817 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:37.730162 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2225d13-ab73-4529-819e-604cc1e1c817 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:37.742509 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9254b9f0-4669-497f-affb-b16db0ca9522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:37.743131 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9254b9f0-4669-497f-affb-b16db0ca9522 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:37.743408 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9254b9f0-4669-497f-affb-b16db0ca9522 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:37.743677 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9254b9f0-4669-497f-affb-b16db0ca9522 None admin] PATH_INFO: `/v3/domains` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:37.744363 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9254b9f0-4669-497f-affb-b16db0ca9522 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:37.744663 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9254b9f0-4669-497f-affb-b16db0ca9522 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:37.746079 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9254b9f0-4669-497f-affb-b16db0ca9522 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:37.747910 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 308/636] 10.222.0.66 () {56 vars in 1148 bytes} [Mon Jul 25 21:22:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:37.748921 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2225d13-ab73-4529-819e-604cc1e1c817 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:37.762329 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 329/637] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Jul 25 21:22:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:37.762329 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9254b9f0-4669-497f-affb-b16db0ca9522 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:37.781731 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:37.858290 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2225d13-ab73-4529-819e-604cc1e1c817 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:37.869528 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9254b9f0-4669-497f-affb-b16db0ca9522 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:37.898947 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8396196-0ae0-4c84-9bb1-6adbcdae5230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:37.899917 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8396196-0ae0-4c84-9bb1-6adbcdae5230 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:37.900344 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8396196-0ae0-4c84-9bb1-6adbcdae5230 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:37.900764 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8396196-0ae0-4c84-9bb1-6adbcdae5230 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:37.907970 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8b4bcc-2671-4253-a032-8483923c30f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:37.908595 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8b4bcc-2671-4253-a032-8483923c30f6 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:37.909041 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8b4bcc-2671-4253-a032-8483923c30f6 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:37.909358 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8b4bcc-2671-4253-a032-8483923c30f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:37.910165 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8b4bcc-2671-4253-a032-8483923c30f6 None admin] RBAC: Adding query filter params (role.id=a3f3fbd04ac04f888e9d384179040765, scope.project.id=7e36d923af474a07adb12209580f12e1, user.id=b36a8b42b275490d8f7fbd4e16f398fa) {{(pid=87209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:37.910476 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8b4bcc-2671-4253-a032-8483923c30f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:37.911941 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8b4bcc-2671-4253-a032-8483923c30f6 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:37.915498 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8396196-0ae0-4c84-9bb1-6adbcdae5230 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:22:37.919072 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 330/638] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Jul 25 21:22:37 2022] GET /identity/v3/role_assignments?user.id=b36a8b42b275490d8f7fbd4e16f398fa&scope.project.id=7e36d923af474a07adb12209580f12e1&role.id=a3f3fbd04ac04f888e9d384179040765 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:37.919936 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8b4bcc-2671-4253-a032-8483923c30f6 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:37.921479 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application [None req-a8396196-0ae0-4c84-9bb1-6adbcdae5230 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 21:22:37.921479 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:22:37.921479 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:22:37.921479 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:22:37.921479 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:22:37.921479 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:22:37.921479 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:22:37.921479 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:22:37.921479 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:22:37.921479 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:22:37.921479 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:22:37.921479 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:22:37.921479 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:22:37.921479 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:22:37.921479 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:22:37.921479 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:22:37.922426 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:22:37.922426 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:22:37.922426 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:22:37.922426 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:22:37.922426 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:22:37.922426 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:22:37.922426 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:22:37.922426 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:22:37.922426 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:22:37.922426 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:22:37.922426 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:22:37.922426 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application with Lock( Jul 25 21:22:37.922426 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:22:37.922426 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:22:37.922426 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:22:37.922426 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:22:37.923284 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:22:37.923284 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:22:37.923284 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:22:37.923284 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:22:37.923284 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:22:37.923284 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:22:37.923284 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:22:37.923284 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:22:37.923284 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:22:37.923284 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:22:37.923284 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 21:22:37.923284 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Jul 25 21:22:37.923284 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 309/639] 10.222.0.66 () {56 vars in 1096 bytes} [Mon Jul 25 21:22:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:22:37.939297 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8396196-0ae0-4c84-9bb1-6adbcdae5230 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:37.963265 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:38.045422 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:38.071702 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8b4bcc-2671-4253-a032-8483923c30f6 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:38.092769 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8396196-0ae0-4c84-9bb1-6adbcdae5230 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:38.110760 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e235f8e-4da4-47e2-8708-f20b4a17fa25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:38.112128 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e235f8e-4da4-47e2-8708-f20b4a17fa25 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:38.112128 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e235f8e-4da4-47e2-8708-f20b4a17fa25 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:38.112329 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e235f8e-4da4-47e2-8708-f20b4a17fa25 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:38.121118 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e235f8e-4da4-47e2-8708-f20b4a17fa25 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:38.121799 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e235f8e-4da4-47e2-8708-f20b4a17fa25 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:38.135715 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application [None req-0e235f8e-4da4-47e2-8708-f20b4a17fa25 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:22:38.135715 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:22:38.135715 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:22:38.135715 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:22:38.135715 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:22:38.135715 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:22:38.135715 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:22:38.135715 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:22:38.135715 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:22:38.135715 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:22:38.135715 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:22:38.135715 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:22:38.135715 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 21:22:38.135715 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 21:22:38.135715 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 21:22:38.136772 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 21:22:38.136772 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:22:38.136772 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:22:38.136772 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:22:38.136772 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:22:38.136772 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:22:38.136772 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:22:38.136772 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:22:38.136772 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application with Lock( Jul 25 21:22:38.136772 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:22:38.136772 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:22:38.136772 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:22:38.136772 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:22:38.136772 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:22:38.136772 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:22:38.136772 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:22:38.136772 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:22:38.137778 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 21:22:38.137778 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 21:22:38.137778 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 21:22:38.137778 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 21:22:38.137778 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 21:22:38.137778 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 21:22:38.137778 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:22:38.137778 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Jul 25 21:22:38.137778 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 331/640] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Jul 25 21:22:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:22:38.142342 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2873afaa-5225-4be0-9123-b3a177f3b191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:38.143091 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e235f8e-4da4-47e2-8708-f20b4a17fa25 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:38.143556 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2873afaa-5225-4be0-9123-b3a177f3b191 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:38.144014 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2873afaa-5225-4be0-9123-b3a177f3b191 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:38.144458 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2873afaa-5225-4be0-9123-b3a177f3b191 None admin] PATH_INFO: `/v3/roles` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:38.145422 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2873afaa-5225-4be0-9123-b3a177f3b191 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:38.145895 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2873afaa-5225-4be0-9123-b3a177f3b191 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:38.147724 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2873afaa-5225-4be0-9123-b3a177f3b191 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:38.161301 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 310/641] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Jul 25 21:22:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:38.163265 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2873afaa-5225-4be0-9123-b3a177f3b191 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:38.247052 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:38.251623 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e235f8e-4da4-47e2-8708-f20b4a17fa25 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:38.282457 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2873afaa-5225-4be0-9123-b3a177f3b191 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:38.286929 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ea9f0a-c1fd-4837-9add-3e40c2c3d480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:38.287830 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ea9f0a-c1fd-4837-9add-3e40c2c3d480 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:38.288304 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ea9f0a-c1fd-4837-9add-3e40c2c3d480 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:38.288792 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ea9f0a-c1fd-4837-9add-3e40c2c3d480 None admin] PATH_INFO: `/v3/projects` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:38.290140 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ea9f0a-c1fd-4837-9add-3e40c2c3d480 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:38.290642 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ea9f0a-c1fd-4837-9add-3e40c2c3d480 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:38.292286 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ea9f0a-c1fd-4837-9add-3e40c2c3d480 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:38.302124 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:38.306923 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 332/642] 10.222.0.66 () {56 vars in 1148 bytes} [Mon Jul 25 21:22:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:38.313072 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ea9f0a-c1fd-4837-9add-3e40c2c3d480 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:38.328340 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4913b5ec-ba95-4f2f-8936-cf6c125ddffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:38.329329 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4913b5ec-ba95-4f2f-8936-cf6c125ddffe None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:38.329783 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4913b5ec-ba95-4f2f-8936-cf6c125ddffe None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:38.330518 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4913b5ec-ba95-4f2f-8936-cf6c125ddffe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:38.342994 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4913b5ec-ba95-4f2f-8936-cf6c125ddffe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:38.344925 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4913b5ec-ba95-4f2f-8936-cf6c125ddffe None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:38.361036 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application [None req-4913b5ec-ba95-4f2f-8936-cf6c125ddffe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:22:38.361036 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:22:38.361036 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:22:38.361036 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:22:38.361036 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:22:38.361036 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:22:38.361036 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:22:38.361036 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:22:38.361036 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:22:38.361036 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:22:38.361036 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:22:38.361036 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:22:38.361036 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:22:38.361036 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:22:38.361036 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:22:38.362042 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:22:38.362042 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:22:38.362042 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:22:38.362042 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:22:38.362042 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:22:38.362042 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:22:38.362042 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:22:38.362042 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:22:38.362042 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application with Lock( Jul 25 21:22:38.362042 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:22:38.362042 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:22:38.362042 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:22:38.362042 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:22:38.362042 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:22:38.362042 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:22:38.362042 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:22:38.362042 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:22:38.362919 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:22:38.362919 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:22:38.362919 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:22:38.362919 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Jul 25 21:22:38.365344 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 311/643] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 25 21:22:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 21:22:38.376911 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4913b5ec-ba95-4f2f-8936-cf6c125ddffe None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:38.421922 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ea9f0a-c1fd-4837-9add-3e40c2c3d480 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:38.459128 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64381cd-bd7a-4f36-8182-e1f86ed1e2e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:38.459852 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64381cd-bd7a-4f36-8182-e1f86ed1e2e1 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:38.460220 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64381cd-bd7a-4f36-8182-e1f86ed1e2e1 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:38.460561 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64381cd-bd7a-4f36-8182-e1f86ed1e2e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:38.461443 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64381cd-bd7a-4f36-8182-e1f86ed1e2e1 None admin] RBAC: Adding query filter params (role.id=a3f3fbd04ac04f888e9d384179040765, scope.project.id=7e36d923af474a07adb12209580f12e1, user.id=704ea1ca162d4df3ab560d910d599851) {{(pid=87209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:38.461815 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64381cd-bd7a-4f36-8182-e1f86ed1e2e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:38.463337 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64381cd-bd7a-4f36-8182-e1f86ed1e2e1 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:38.469893 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 333/644] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Jul 25 21:22:38 2022] GET /identity/v3/role_assignments?user.id=704ea1ca162d4df3ab560d910d599851&scope.project.id=7e36d923af474a07adb12209580f12e1&role.id=a3f3fbd04ac04f888e9d384179040765 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:22:38.486919 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4913b5ec-ba95-4f2f-8936-cf6c125ddffe None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:38.516240 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:38.529286 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d173aca-e5a7-4d55-8d61-1ded2e64dd70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:38.529939 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d173aca-e5a7-4d55-8d61-1ded2e64dd70 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:38.530222 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d173aca-e5a7-4d55-8d61-1ded2e64dd70 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:38.530498 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d173aca-e5a7-4d55-8d61-1ded2e64dd70 None admin] PATH_INFO: `/v3/domains` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:38.531205 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d173aca-e5a7-4d55-8d61-1ded2e64dd70 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:38.531515 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d173aca-e5a7-4d55-8d61-1ded2e64dd70 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:38.532933 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d173aca-e5a7-4d55-8d61-1ded2e64dd70 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:38.548021 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 312/645] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Jul 25 21:22:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:38.553600 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64381cd-bd7a-4f36-8182-e1f86ed1e2e1 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:38.627157 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:38.669888 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64381cd-bd7a-4f36-8182-e1f86ed1e2e1 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:38.706441 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8990b2fc-79c8-4fc0-8b67-9c5225026926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:38.707493 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8990b2fc-79c8-4fc0-8b67-9c5225026926 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:38.707985 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8990b2fc-79c8-4fc0-8b67-9c5225026926 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:38.708265 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8990b2fc-79c8-4fc0-8b67-9c5225026926 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:38.716645 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8990b2fc-79c8-4fc0-8b67-9c5225026926 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:38.718119 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8990b2fc-79c8-4fc0-8b67-9c5225026926 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:38.730057 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application [None req-8990b2fc-79c8-4fc0-8b67-9c5225026926 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 21:22:38.730057 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:22:38.730057 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:22:38.730057 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:22:38.730057 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:22:38.730057 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:22:38.730057 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:22:38.730057 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:22:38.730057 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:22:38.730057 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:22:38.730057 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:22:38.730057 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:22:38.730057 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 21:22:38.730057 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 21:22:38.730057 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 21:22:38.730057 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 21:22:38.731017 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:22:38.731017 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:22:38.731017 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 21:22:38.731017 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:22:38.731017 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 21:22:38.731017 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:22:38.731017 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:22:38.731017 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:22:38.731017 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:22:38.731017 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:22:38.731017 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:22:38.731017 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application with Lock( Jul 25 21:22:38.731017 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:22:38.731017 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:22:38.731017 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:22:38.731017 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:22:38.731017 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:22:38.731017 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:22:38.731983 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:22:38.731983 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:22:38.731983 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 21:22:38.731983 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 21:22:38.731983 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 21:22:38.731983 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 21:22:38.731983 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 21:22:38.731983 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 21:22:38.731983 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 21:22:38.731983 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Jul 25 21:22:38.731983 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 334/646] 10.222.0.66 () {56 vars in 1093 bytes} [Mon Jul 25 21:22:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:22:38.739203 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d173aca-e5a7-4d55-8d61-1ded2e64dd70 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:38.844998 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d173aca-e5a7-4d55-8d61-1ded2e64dd70 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:38.887472 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cfe2c7-c1de-4bdc-9c9c-7ddb1f2ace66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:38.888153 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cfe2c7-c1de-4bdc-9c9c-7ddb1f2ace66 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:38.888392 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cfe2c7-c1de-4bdc-9c9c-7ddb1f2ace66 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:38.888661 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cfe2c7-c1de-4bdc-9c9c-7ddb1f2ace66 None admin] PATH_INFO: `/v3/users` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:38.889537 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cfe2c7-c1de-4bdc-9c9c-7ddb1f2ace66 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:38.889846 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cfe2c7-c1de-4bdc-9c9c-7ddb1f2ace66 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:38.891374 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cfe2c7-c1de-4bdc-9c9c-7ddb1f2ace66 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:38.913503 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 313/647] 10.222.0.66 () {56 vars in 1133 bytes} [Mon Jul 25 21:22:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:38.919624 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8990b2fc-79c8-4fc0-8b67-9c5225026926 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:39.037314 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8990b2fc-79c8-4fc0-8b67-9c5225026926 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:39.041036 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f511da3d-ca69-4f93-9456-cc7474158ff8 None None] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:39.041349 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f511da3d-ca69-4f93-9456-cc7474158ff8 None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:39.041616 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f511da3d-ca69-4f93-9456-cc7474158ff8 None None] PATH_INFO: `/` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:39.046934 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 314/648] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:22:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:22:39.048529 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54f3251-23ec-4ad6-9e37-b565fbbc46e7 None None] REQUEST_METHOD: `POST` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:39.048872 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54f3251-23ec-4ad6-9e37-b565fbbc46e7 None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:39.049172 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54f3251-23ec-4ad6-9e37-b565fbbc46e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:39.063375 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:39.076703 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5cacf3-718a-4d62-bac4-b0767d86e0a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:39.077735 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5cacf3-718a-4d62-bac4-b0767d86e0a6 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:39.077979 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.auth.core [None req-a54f3251-23ec-4ad6-9e37-b565fbbc46e7 None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:22:39.079337 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.fernet_utils [None req-a54f3251-23ec-4ad6-9e37-b565fbbc46e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:22:39.079621 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5cacf3-718a-4d62-bac4-b0767d86e0a6 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:39.080272 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5cacf3-718a-4d62-bac4-b0767d86e0a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:39.125595 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:39.156403 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5cacf3-718a-4d62-bac4-b0767d86e0a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:39.158333 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5cacf3-718a-4d62-bac4-b0767d86e0a6 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:39.165387 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 315/649] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:22:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 21:22:39.188134 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54f3251-23ec-4ad6-9e37-b565fbbc46e7 None None] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:39.285622 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 335/650] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Jul 25 21:22:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 21:22:39.298380 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5cacf3-718a-4d62-bac4-b0767d86e0a6 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:39.310855 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54f3251-23ec-4ad6-9e37-b565fbbc46e7 None None] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:39.329321 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:39.351972 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dd7747-f213-4319-93f7-9c08bda050a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:39.352628 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dd7747-f213-4319-93f7-9c08bda050a2 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:39.352900 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dd7747-f213-4319-93f7-9c08bda050a2 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:39.353202 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dd7747-f213-4319-93f7-9c08bda050a2 None admin] PATH_INFO: `/v3/services/image` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:39.353980 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dd7747-f213-4319-93f7-9c08bda050a2 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:39.355397 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dd7747-f213-4319-93f7-9c08bda050a2 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:39.367194 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application [None req-93dd7747-f213-4319-93f7-9c08bda050a2 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 21:22:39.367194 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:22:39.367194 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 21:22:39.367194 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 21:22:39.367194 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 21:22:39.367194 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 21:22:39.367194 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 21:22:39.367194 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 21:22:39.367194 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 21:22:39.367194 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Jul 25 21:22:39.367194 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 21:22:39.367194 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Jul 25 21:22:39.367194 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:22:39.367194 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:22:39.367194 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:22:39.367194 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:22:39.367194 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:22:39.368250 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:22:39.368250 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:22:39.368250 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:22:39.368250 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:22:39.368250 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:22:39.368250 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:22:39.368250 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 21:22:39.368250 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 21:22:39.368250 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 21:22:39.368250 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 21:22:39.368250 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:22:39.368250 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:22:39.368250 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:22:39.368250 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:22:39.368250 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:22:39.368250 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:22:39.369615 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:22:39.369615 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application with Lock( Jul 25 21:22:39.369615 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:22:39.369615 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:22:39.369615 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:22:39.369615 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:22:39.369615 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:22:39.369615 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:22:39.369615 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:22:39.369615 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:22:39.369615 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 21:22:39.369615 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 21:22:39.369615 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 21:22:39.369615 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Jul 25 21:22:39.373398 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 316/651] 10.222.0.66 () {56 vars in 1105 bytes} [Mon Jul 25 21:22:39 2022] GET /identity/v3/services/image => generated 86 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:22:39.374228 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dd7747-f213-4319-93f7-9c08bda050a2 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:39.413956 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:39.432680 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5cacf3-718a-4d62-bac4-b0767d86e0a6 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:39.478046 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf05e7e0-80a1-402a-9ca5-ac10b513e438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:39.479625 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf05e7e0-80a1-402a-9ca5-ac10b513e438 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:39.480096 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf05e7e0-80a1-402a-9ca5-ac10b513e438 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:39.480760 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf05e7e0-80a1-402a-9ca5-ac10b513e438 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:39.485543 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dd7747-f213-4319-93f7-9c08bda050a2 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:39.494224 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf05e7e0-80a1-402a-9ca5-ac10b513e438 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:39.496663 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf05e7e0-80a1-402a-9ca5-ac10b513e438 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:39.516011 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application [None req-bf05e7e0-80a1-402a-9ca5-ac10b513e438 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:22:39.516011 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:22:39.516011 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:22:39.516011 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:22:39.516011 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:22:39.516011 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:22:39.516011 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:22:39.516011 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:22:39.516011 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:22:39.516011 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:22:39.516011 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:22:39.516011 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:22:39.516011 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:22:39.516011 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:22:39.516011 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:22:39.517114 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:22:39.517114 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:22:39.517114 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:22:39.517114 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:22:39.517114 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:22:39.517114 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:22:39.517114 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:22:39.517114 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:22:39.517114 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application with Lock( Jul 25 21:22:39.517114 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:22:39.517114 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:22:39.517114 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:22:39.517114 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:22:39.517114 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:22:39.517114 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:22:39.517114 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:22:39.517114 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:22:39.518560 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:22:39.518560 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:22:39.518560 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:22:39.518560 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Jul 25 21:22:39.524733 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 336/652] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 25 21:22:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:22:39.525741 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf05e7e0-80a1-402a-9ca5-ac10b513e438 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:39.531413 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb0ec66-d57e-4c38-a800-2b9f85105647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:39.532256 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb0ec66-d57e-4c38-a800-2b9f85105647 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:39.532698 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb0ec66-d57e-4c38-a800-2b9f85105647 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:39.533178 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb0ec66-d57e-4c38-a800-2b9f85105647 None admin] PATH_INFO: `/v3/services` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:39.534054 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb0ec66-d57e-4c38-a800-2b9f85105647 None admin] RBAC: Adding query filter params (name=image) {{(pid=87210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:39.534507 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb0ec66-d57e-4c38-a800-2b9f85105647 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:39.536607 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb0ec66-d57e-4c38-a800-2b9f85105647 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:39.544003 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 317/653] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 25 21:22:39 2022] GET /identity/v3/services?name=image => generated 122 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:39.549374 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb0ec66-d57e-4c38-a800-2b9f85105647 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:39.617608 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:39.650062 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf05e7e0-80a1-402a-9ca5-ac10b513e438 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:39.675364 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:39.682568 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb0ec66-d57e-4c38-a800-2b9f85105647 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:39.690563 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6887f6a4-fb81-49e2-98b2-285880d558ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:39.691316 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6887f6a4-fb81-49e2-98b2-285880d558ed None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:39.691665 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6887f6a4-fb81-49e2-98b2-285880d558ed None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:39.692008 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6887f6a4-fb81-49e2-98b2-285880d558ed None admin] PATH_INFO: `/v3/domains` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:39.692770 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6887f6a4-fb81-49e2-98b2-285880d558ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=87209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:39.693185 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6887f6a4-fb81-49e2-98b2-285880d558ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:39.695091 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6887f6a4-fb81-49e2-98b2-285880d558ed None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:39.719539 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 337/654] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Jul 25 21:22:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:39.721946 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6887f6a4-fb81-49e2-98b2-285880d558ed None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:39.730563 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839ea4f6-f69e-4fa5-bdb9-e503d2f3c356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:39.731242 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839ea4f6-f69e-4fa5-bdb9-e503d2f3c356 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:39.731524 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839ea4f6-f69e-4fa5-bdb9-e503d2f3c356 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:39.731792 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839ea4f6-f69e-4fa5-bdb9-e503d2f3c356 None admin] PATH_INFO: `/v3/services` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:39.732517 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839ea4f6-f69e-4fa5-bdb9-e503d2f3c356 None admin] RBAC: Adding query filter params (type=image) {{(pid=87210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:39.732820 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839ea4f6-f69e-4fa5-bdb9-e503d2f3c356 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:39.734340 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839ea4f6-f69e-4fa5-bdb9-e503d2f3c356 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:39.741133 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 318/655] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 25 21:22:39 2022] GET /identity/v3/services?type=image => generated 122 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:22:39.844989 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6887f6a4-fb81-49e2-98b2-285880d558ed None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:39.884680 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1826b2-627b-4199-bc54-02a3ae2c64f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:39.885382 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1826b2-627b-4199-bc54-02a3ae2c64f6 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:39.885758 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1826b2-627b-4199-bc54-02a3ae2c64f6 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:39.886037 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1826b2-627b-4199-bc54-02a3ae2c64f6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:39.889338 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:39.895045 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1826b2-627b-4199-bc54-02a3ae2c64f6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:39.896561 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1826b2-627b-4199-bc54-02a3ae2c64f6 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:39.909930 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application [None req-0a1826b2-627b-4199-bc54-02a3ae2c64f6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:22:39.909930 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:22:39.909930 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:22:39.909930 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:22:39.909930 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:22:39.909930 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:22:39.909930 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:22:39.909930 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:22:39.909930 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:22:39.909930 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:22:39.909930 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:22:39.909930 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:22:39.909930 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 21:22:39.909930 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 21:22:39.909930 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 21:22:39.911203 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 21:22:39.911203 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:22:39.911203 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:22:39.911203 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:22:39.911203 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:22:39.911203 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:22:39.911203 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:22:39.911203 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:22:39.911203 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application with Lock( Jul 25 21:22:39.911203 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:22:39.911203 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:22:39.911203 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:22:39.911203 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:22:39.911203 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:22:39.911203 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:22:39.911203 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:22:39.911203 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:22:39.912146 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 21:22:39.912146 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 21:22:39.912146 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 21:22:39.912146 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 21:22:39.912146 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 21:22:39.912146 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 21:22:39.912146 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:22:39.912146 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Jul 25 21:22:39.916188 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 338/656] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Jul 25 21:22:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:22:39.918528 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839ea4f6-f69e-4fa5-bdb9-e503d2f3c356 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:40.032881 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839ea4f6-f69e-4fa5-bdb9-e503d2f3c356 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:40.073280 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640d1767-82d6-42e0-bde7-c664e986f477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:40.073912 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640d1767-82d6-42e0-bde7-c664e986f477 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:40.074186 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640d1767-82d6-42e0-bde7-c664e986f477 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:40.074456 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640d1767-82d6-42e0-bde7-c664e986f477 None admin] PATH_INFO: `/v3/projects` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:40.075202 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640d1767-82d6-42e0-bde7-c664e986f477 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:40.075503 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640d1767-82d6-42e0-bde7-c664e986f477 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:40.077033 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640d1767-82d6-42e0-bde7-c664e986f477 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:40.091716 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 319/657] 10.222.0.66 () {56 vars in 1148 bytes} [Mon Jul 25 21:22:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:40.102714 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1826b2-627b-4199-bc54-02a3ae2c64f6 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:40.209832 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1826b2-627b-4199-bc54-02a3ae2c64f6 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:40.245408 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7efbc1-8356-4dd9-8913-825b9120c696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:40.246437 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7efbc1-8356-4dd9-8913-825b9120c696 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:40.246945 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7efbc1-8356-4dd9-8913-825b9120c696 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:40.247437 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7efbc1-8356-4dd9-8913-825b9120c696 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:40.248450 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7efbc1-8356-4dd9-8913-825b9120c696 None admin] RBAC: Adding query filter params (role.id=216a86497a3a4593ba08730ea8697df3, scope.project.id=7e36d923af474a07adb12209580f12e1, user.id=524584f0d1b64e02a467b47de395c130) {{(pid=87209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:40.248973 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7efbc1-8356-4dd9-8913-825b9120c696 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:40.250732 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7efbc1-8356-4dd9-8913-825b9120c696 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:40.265247 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 339/658] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Jul 25 21:22:40 2022] GET /identity/v3/role_assignments?user.id=524584f0d1b64e02a467b47de395c130&scope.project.id=7e36d923af474a07adb12209580f12e1&role.id=216a86497a3a4593ba08730ea8697df3 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:40.416322 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d118c478-ec0c-4f80-b884-5ddcd626175b None None] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:40.416701 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d118c478-ec0c-4f80-b884-5ddcd626175b None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:40.416879 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d118c478-ec0c-4f80-b884-5ddcd626175b None None] PATH_INFO: `/` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:40.418610 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 320/659] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:22:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:22:40.424397 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9dfb82-e0dc-4ee0-81f8-fb6d01dbe0c9 None None] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:40.425012 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9dfb82-e0dc-4ee0-81f8-fb6d01dbe0c9 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:40.425514 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9dfb82-e0dc-4ee0-81f8-fb6d01dbe0c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:40.446171 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.auth.core [None req-3d9dfb82-e0dc-4ee0-81f8-fb6d01dbe0c9 None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:22:40.447740 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-3d9dfb82-e0dc-4ee0-81f8-fb6d01dbe0c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:22:40.508679 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:40.520801 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 340/660] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:22:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:22:40.544760 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d118c478-ec0c-4f80-b884-5ddcd626175b None None] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:40.572848 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:40.656229 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d118c478-ec0c-4f80-b884-5ddcd626175b None None] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:40.693752 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c839d99-3683-4268-bc4b-2b15e19ab12d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:40.694505 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c839d99-3683-4268-bc4b-2b15e19ab12d None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:40.694785 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c839d99-3683-4268-bc4b-2b15e19ab12d None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:40.695059 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c839d99-3683-4268-bc4b-2b15e19ab12d None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:40.695699 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c839d99-3683-4268-bc4b-2b15e19ab12d None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:40.697161 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c839d99-3683-4268-bc4b-2b15e19ab12d None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:40.707555 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application [None req-4c839d99-3683-4268-bc4b-2b15e19ab12d None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 21:22:40.707555 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:22:40.707555 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 21:22:40.707555 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 21:22:40.707555 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 21:22:40.707555 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 21:22:40.707555 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 21:22:40.707555 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 21:22:40.707555 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 21:22:40.707555 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Jul 25 21:22:40.707555 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 21:22:40.707555 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Jul 25 21:22:40.707555 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:22:40.707555 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:22:40.707555 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:22:40.707555 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:22:40.708598 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:22:40.708598 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:22:40.708598 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:22:40.708598 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:22:40.708598 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:22:40.708598 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:22:40.708598 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:22:40.708598 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 21:22:40.708598 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 21:22:40.708598 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 21:22:40.708598 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 21:22:40.708598 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:22:40.708598 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:22:40.708598 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:22:40.708598 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:22:40.708598 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:22:40.709831 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:22:40.709831 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:22:40.709831 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application with Lock( Jul 25 21:22:40.709831 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:22:40.709831 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:22:40.709831 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:22:40.709831 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:22:40.709831 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:22:40.709831 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:22:40.709831 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:22:40.709831 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:22:40.709831 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 21:22:40.709831 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 21:22:40.709831 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 21:22:40.709831 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Jul 25 21:22:40.709831 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 321/661] 10.222.0.66 () {56 vars in 1129 bytes} [Mon Jul 25 21:22:40 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:22:40.715187 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9dfb82-e0dc-4ee0-81f8-fb6d01dbe0c9 None None] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:40.822456 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9dfb82-e0dc-4ee0-81f8-fb6d01dbe0c9 None None] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:40.858107 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2bfc1d-251d-49b1-898d-05831a00281a None None] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:40.858464 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2bfc1d-251d-49b1-898d-05831a00281a None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:40.858656 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2bfc1d-251d-49b1-898d-05831a00281a None None] PATH_INFO: `/` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:40.859492 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77da125b-b837-46d3-9a4d-64893ba02c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:40.860132 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77da125b-b837-46d3-9a4d-64893ba02c1e None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:40.860353 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 322/662] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:22:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:22:40.860454 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77da125b-b837-46d3-9a4d-64893ba02c1e None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:40.860673 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77da125b-b837-46d3-9a4d-64893ba02c1e None admin] PATH_INFO: `/v3/services` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:40.864869 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77da125b-b837-46d3-9a4d-64893ba02c1e None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:40.864869 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77da125b-b837-46d3-9a4d-64893ba02c1e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:40.864869 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77da125b-b837-46d3-9a4d-64893ba02c1e None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:40.866850 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0bc3bc-aef9-4c0f-ada7-f82a8bd63c76 None None] REQUEST_METHOD: `POST` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:40.867401 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0bc3bc-aef9-4c0f-ada7-f82a8bd63c76 None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:40.867881 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0bc3bc-aef9-4c0f-ada7-f82a8bd63c76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:40.869404 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 341/663] 10.222.0.66 () {56 vars in 1124 bytes} [Mon Jul 25 21:22:40 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:40.874902 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77da125b-b837-46d3-9a4d-64893ba02c1e None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:40.888485 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.auth.core [None req-2e0bc3bc-aef9-4c0f-ada7-f82a8bd63c76 None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:22:40.890187 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.fernet_utils [None req-2e0bc3bc-aef9-4c0f-ada7-f82a8bd63c76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:22:40.933092 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:40.980600 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77da125b-b837-46d3-9a4d-64893ba02c1e None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:40.985411 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 323/664] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:22:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 21:22:41.015496 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0bc3bc-aef9-4c0f-ada7-f82a8bd63c76 None None] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:41.019795 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17971d2f-9fa8-44ca-b83c-7ecc3bc9d051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:41.020438 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17971d2f-9fa8-44ca-b83c-7ecc3bc9d051 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:41.020719 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17971d2f-9fa8-44ca-b83c-7ecc3bc9d051 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:41.020997 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17971d2f-9fa8-44ca-b83c-7ecc3bc9d051 None admin] PATH_INFO: `/v3/services` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:41.021728 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17971d2f-9fa8-44ca-b83c-7ecc3bc9d051 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:41.022032 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17971d2f-9fa8-44ca-b83c-7ecc3bc9d051 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:41.023553 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17971d2f-9fa8-44ca-b83c-7ecc3bc9d051 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:41.030094 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 342/665] 10.222.0.66 () {56 vars in 1124 bytes} [Mon Jul 25 21:22:40 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:41.037739 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:41.134389 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0bc3bc-aef9-4c0f-ada7-f82a8bd63c76 None None] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:41.172597 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcbb913-295f-428e-bf99-1e643d887328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:41.173830 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcbb913-295f-428e-bf99-1e643d887328 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:41.174439 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcbb913-295f-428e-bf99-1e643d887328 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:41.175118 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcbb913-295f-428e-bf99-1e643d887328 None admin] PATH_INFO: `/v3/services/network` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:41.176052 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcbb913-295f-428e-bf99-1e643d887328 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:41.177703 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcbb913-295f-428e-bf99-1e643d887328 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:41.187923 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application [None req-2fcbb913-295f-428e-bf99-1e643d887328 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 21:22:41.187923 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:22:41.187923 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 21:22:41.187923 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 21:22:41.187923 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 21:22:41.187923 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 21:22:41.187923 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 21:22:41.187923 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 21:22:41.187923 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 21:22:41.187923 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Jul 25 21:22:41.187923 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 21:22:41.187923 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Jul 25 21:22:41.187923 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:22:41.187923 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:22:41.187923 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:22:41.187923 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:22:41.187923 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:22:41.189003 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:22:41.189003 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:22:41.189003 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:22:41.189003 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:22:41.189003 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:22:41.189003 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:22:41.189003 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 21:22:41.189003 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 21:22:41.189003 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 21:22:41.189003 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 21:22:41.189003 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:22:41.189003 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:22:41.189003 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:22:41.189003 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:22:41.189003 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:22:41.189003 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:22:41.190296 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:22:41.190296 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application with Lock( Jul 25 21:22:41.190296 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:22:41.190296 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:22:41.190296 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:22:41.190296 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:22:41.190296 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:22:41.190296 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:22:41.190296 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:22:41.190296 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:22:41.190296 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 21:22:41.190296 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 21:22:41.190296 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 21:22:41.190296 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Jul 25 21:22:41.193476 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 324/666] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Jul 25 21:22:41 2022] GET /identity/v3/services/network => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:22:41.202248 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17971d2f-9fa8-44ca-b83c-7ecc3bc9d051 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:41.308893 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17971d2f-9fa8-44ca-b83c-7ecc3bc9d051 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:41.327282 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:41.345802 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f043dd-0ca0-45bf-a607-43978ae6bde9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:41.346441 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f043dd-0ca0-45bf-a607-43978ae6bde9 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:41.346718 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f043dd-0ca0-45bf-a607-43978ae6bde9 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:41.346990 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f043dd-0ca0-45bf-a607-43978ae6bde9 None admin] PATH_INFO: `/v3/services` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:41.347661 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f043dd-0ca0-45bf-a607-43978ae6bde9 None admin] RBAC: Adding query filter params (name=network) {{(pid=87209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:41.347961 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f043dd-0ca0-45bf-a607-43978ae6bde9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:41.349365 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f043dd-0ca0-45bf-a607-43978ae6bde9 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:41.354247 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 343/667] 10.222.0.66 () {56 vars in 1112 bytes} [Mon Jul 25 21:22:41 2022] GET /identity/v3/services?name=network => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:41.359823 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcbb913-295f-428e-bf99-1e643d887328 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:41.446395 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:41.465795 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcbb913-295f-428e-bf99-1e643d887328 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:41.501433 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8192149c-d3f1-4019-918c-2cb967089943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:41.502230 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8192149c-d3f1-4019-918c-2cb967089943 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:41.502504 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8192149c-d3f1-4019-918c-2cb967089943 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:41.502769 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8192149c-d3f1-4019-918c-2cb967089943 None admin] PATH_INFO: `/v3/services` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:41.503447 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8192149c-d3f1-4019-918c-2cb967089943 None admin] RBAC: Adding query filter params (type=network) {{(pid=87210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:41.503746 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8192149c-d3f1-4019-918c-2cb967089943 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:41.505195 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8192149c-d3f1-4019-918c-2cb967089943 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:41.510410 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 325/668] 10.222.0.66 () {56 vars in 1112 bytes} [Mon Jul 25 21:22:41 2022] GET /identity/v3/services?type=network => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:42.133124 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636454ab-c386-4858-bff7-ee5914372695 None None] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:42.133667 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636454ab-c386-4858-bff7-ee5914372695 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:42.133667 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636454ab-c386-4858-bff7-ee5914372695 None None] PATH_INFO: `/` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:42.135290 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 344/669] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:22:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:22:42.140911 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50362e03-cd6d-4c00-8d04-c43bde40309e None None] REQUEST_METHOD: `POST` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:42.141391 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50362e03-cd6d-4c00-8d04-c43bde40309e None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:42.141483 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50362e03-cd6d-4c00-8d04-c43bde40309e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:42.160634 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.auth.core [None req-50362e03-cd6d-4c00-8d04-c43bde40309e None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:22:42.161864 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.fernet_utils [None req-50362e03-cd6d-4c00-8d04-c43bde40309e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:22:42.237649 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 326/670] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:22:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:22:42.257556 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636454ab-c386-4858-bff7-ee5914372695 None None] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:42.368752 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636454ab-c386-4858-bff7-ee5914372695 None None] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:42.404401 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a576657e-fbeb-4e6a-bd64-956f446b70a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:42.405265 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a576657e-fbeb-4e6a-bd64-956f446b70a9 None admin] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:42.405552 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a576657e-fbeb-4e6a-bd64-956f446b70a9 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:42.405825 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a576657e-fbeb-4e6a-bd64-956f446b70a9 None admin] PATH_INFO: `/v3/services` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:42.406685 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a576657e-fbeb-4e6a-bd64-956f446b70a9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:42.408317 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a576657e-fbeb-4e6a-bd64-956f446b70a9 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:42.432813 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 345/671] 10.222.0.66 () {60 vars in 1141 bytes} [Mon Jul 25 21:22:42 2022] POST /identity/v3/services => generated 242 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 21:22:42.572202 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4803693b-cbcc-493b-98d7-4aa63a05eaad None None] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:42.572624 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4803693b-cbcc-493b-98d7-4aa63a05eaad None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:42.572794 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4803693b-cbcc-493b-98d7-4aa63a05eaad None None] PATH_INFO: `/` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:42.574556 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 327/672] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:22:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:22:42.580539 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df757d8-7f9c-4ea7-bbb1-25abcb9e8af7 None None] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:42.580867 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df757d8-7f9c-4ea7-bbb1-25abcb9e8af7 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:42.581190 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df757d8-7f9c-4ea7-bbb1-25abcb9e8af7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:42.601961 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.auth.core [None req-9df757d8-7f9c-4ea7-bbb1-25abcb9e8af7 None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:22:42.603254 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-9df757d8-7f9c-4ea7-bbb1-25abcb9e8af7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:22:42.642300 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:42.684528 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 346/673] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:22:42 2022] POST /identity/v3/auth/tokens => generated 895 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:22:42.711336 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4803693b-cbcc-493b-98d7-4aa63a05eaad None None] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:42.790832 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:42.817368 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4803693b-cbcc-493b-98d7-4aa63a05eaad None None] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:42.856857 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed6b7df-6af0-4c74-ad6e-5143419ab90d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:42.857460 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed6b7df-6af0-4c74-ad6e-5143419ab90d None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:42.857740 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed6b7df-6af0-4c74-ad6e-5143419ab90d None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:42.858010 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed6b7df-6af0-4c74-ad6e-5143419ab90d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:42.869261 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed6b7df-6af0-4c74-ad6e-5143419ab90d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:22:42.874284 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application [None req-7ed6b7df-6af0-4c74-ad6e-5143419ab90d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 21:22:42.874284 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:22:42.874284 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:22:42.874284 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:22:42.874284 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:22:42.874284 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:22:42.874284 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:22:42.874284 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:22:42.874284 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:22:42.874284 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:22:42.874284 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:22:42.874284 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:22:42.874284 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:22:42.874284 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:22:42.874284 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:22:42.874284 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:22:42.875230 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:22:42.875230 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:22:42.875230 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:22:42.875230 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:22:42.875230 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:22:42.875230 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:22:42.875230 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:22:42.875230 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:22:42.875230 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:22:42.875230 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:22:42.875230 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:22:42.875230 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application with Lock( Jul 25 21:22:42.875230 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:22:42.875230 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:22:42.875230 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:22:42.875230 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:22:42.876059 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:22:42.876059 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:22:42.876059 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:22:42.876059 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:22:42.876059 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:22:42.876059 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:22:42.876059 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:22:42.876059 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:22:42.876059 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:22:42.876059 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:22:42.876059 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 21:22:42.876059 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Jul 25 21:22:42.876059 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 328/674] 10.222.0.66 () {56 vars in 1096 bytes} [Mon Jul 25 21:22:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:22:42.881624 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df757d8-7f9c-4ea7-bbb1-25abcb9e8af7 None None] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:42.985732 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df757d8-7f9c-4ea7-bbb1-25abcb9e8af7 None None] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:43.021209 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427a9298-3745-4f9d-9187-f90ecf5b1fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:43.021845 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427a9298-3745-4f9d-9187-f90ecf5b1fab None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:43.022123 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427a9298-3745-4f9d-9187-f90ecf5b1fab None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:43.022394 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427a9298-3745-4f9d-9187-f90ecf5b1fab None admin] PATH_INFO: `/v3/roles` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:43.023159 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427a9298-3745-4f9d-9187-f90ecf5b1fab None admin] RBAC: Adding query filter params (name=admin) {{(pid=87209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:43.023462 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427a9298-3745-4f9d-9187-f90ecf5b1fab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:43.024881 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427a9298-3745-4f9d-9187-f90ecf5b1fab None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:43.034036 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 347/675] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Jul 25 21:22:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:43.039986 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed6b7df-6af0-4c74-ad6e-5143419ab90d None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:43.148099 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed6b7df-6af0-4c74-ad6e-5143419ab90d None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:43.184036 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63c08cb-4885-4b61-bee4-ea5d8b0c9d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:43.184691 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63c08cb-4885-4b61-bee4-ea5d8b0c9d45 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:43.184970 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63c08cb-4885-4b61-bee4-ea5d8b0c9d45 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:43.185269 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63c08cb-4885-4b61-bee4-ea5d8b0c9d45 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:43.187137 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:43.196570 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63c08cb-4885-4b61-bee4-ea5d8b0c9d45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:43.198533 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63c08cb-4885-4b61-bee4-ea5d8b0c9d45 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:43.213730 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application [None req-f63c08cb-4885-4b61-bee4-ea5d8b0c9d45 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:22:43.213730 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:22:43.213730 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:22:43.213730 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:22:43.213730 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:22:43.213730 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:22:43.213730 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:22:43.213730 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:22:43.213730 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:22:43.213730 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:22:43.213730 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:22:43.213730 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:22:43.213730 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:22:43.213730 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:22:43.213730 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:22:43.215728 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:22:43.215728 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:22:43.215728 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:22:43.215728 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:22:43.215728 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:22:43.215728 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:22:43.215728 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:22:43.215728 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:22:43.215728 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application with Lock( Jul 25 21:22:43.215728 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:22:43.215728 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:22:43.215728 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:22:43.215728 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:22:43.215728 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:22:43.215728 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:22:43.215728 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:22:43.215728 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:22:43.217807 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:22:43.217807 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:22:43.217807 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:22:43.217807 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Jul 25 21:22:43.217807 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 329/676] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 25 21:22:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:22:43.221716 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427a9298-3745-4f9d-9187-f90ecf5b1fab None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:43.254634 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:43.336773 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427a9298-3745-4f9d-9187-f90ecf5b1fab None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:43.371837 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd04e372-5421-46a3-99be-a9b4aa9cb103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:43.372463 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd04e372-5421-46a3-99be-a9b4aa9cb103 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:43.372738 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd04e372-5421-46a3-99be-a9b4aa9cb103 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:43.373008 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd04e372-5421-46a3-99be-a9b4aa9cb103 None admin] PATH_INFO: `/v3/domains` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:43.373753 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd04e372-5421-46a3-99be-a9b4aa9cb103 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:43.374051 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd04e372-5421-46a3-99be-a9b4aa9cb103 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:43.375455 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd04e372-5421-46a3-99be-a9b4aa9cb103 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:43.387955 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 348/677] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Jul 25 21:22:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:43.393573 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63c08cb-4885-4b61-bee4-ea5d8b0c9d45 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:43.485631 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb99bb5-66d4-47af-8b3d-06866ed6e443 None None] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:43.485830 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb99bb5-66d4-47af-8b3d-06866ed6e443 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:43.486110 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb99bb5-66d4-47af-8b3d-06866ed6e443 None None] PATH_INFO: `/` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:43.487741 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 349/678] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:22:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 21:22:43.493125 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ca4de3-f9de-49d7-b3d5-bbb4c5d76fe1 None None] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:43.493667 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ca4de3-f9de-49d7-b3d5-bbb4c5d76fe1 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:43.494150 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ca4de3-f9de-49d7-b3d5-bbb4c5d76fe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:43.499058 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63c08cb-4885-4b61-bee4-ea5d8b0c9d45 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:43.513715 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.auth.core [None req-70ca4de3-f9de-49d7-b3d5-bbb4c5d76fe1 None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:22:43.515323 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-70ca4de3-f9de-49d7-b3d5-bbb4c5d76fe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:22:43.535917 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd78bc2-f1ab-4f21-b5cc-aebc8a641534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:43.536571 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd78bc2-f1ab-4f21-b5cc-aebc8a641534 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:43.536849 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd78bc2-f1ab-4f21-b5cc-aebc8a641534 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:43.537140 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd78bc2-f1ab-4f21-b5cc-aebc8a641534 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:43.545938 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd78bc2-f1ab-4f21-b5cc-aebc8a641534 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:43.547602 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd78bc2-f1ab-4f21-b5cc-aebc8a641534 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:43.559984 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application [None req-acd78bc2-f1ab-4f21-b5cc-aebc8a641534 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 21:22:43.559984 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:22:43.559984 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:22:43.559984 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:22:43.559984 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:22:43.559984 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:22:43.559984 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:22:43.559984 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:22:43.559984 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:22:43.559984 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:22:43.559984 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:22:43.559984 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:22:43.559984 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 21:22:43.559984 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 21:22:43.559984 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 21:22:43.559984 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 21:22:43.560953 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:22:43.560953 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:22:43.560953 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 21:22:43.560953 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:22:43.560953 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 21:22:43.560953 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:22:43.560953 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:22:43.560953 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:22:43.560953 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:22:43.560953 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:22:43.560953 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:22:43.560953 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application with Lock( Jul 25 21:22:43.560953 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:22:43.560953 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:22:43.560953 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:22:43.560953 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:22:43.560953 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:22:43.560953 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:22:43.561978 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:22:43.561978 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:22:43.561978 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 21:22:43.561978 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 21:22:43.561978 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 21:22:43.561978 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 21:22:43.561978 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 21:22:43.561978 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 21:22:43.561978 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 21:22:43.561978 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Jul 25 21:22:43.561978 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 330/679] 10.222.0.66 () {56 vars in 1093 bytes} [Mon Jul 25 21:22:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:22:43.567381 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd78bc2-f1ab-4f21-b5cc-aebc8a641534 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:43.609247 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 350/680] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:22:43 2022] POST /identity/v3/auth/tokens => generated 895 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:22:43.632510 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:43.634447 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ca4de3-f9de-49d7-b3d5-bbb4c5d76fe1 None None] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:43.656671 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:43.697187 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd78bc2-f1ab-4f21-b5cc-aebc8a641534 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:43.731496 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07e14bd-0d22-4bac-9917-df4e8de21af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:43.732141 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e14bd-0d22-4bac-9917-df4e8de21af7 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:43.732428 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e14bd-0d22-4bac-9917-df4e8de21af7 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:43.732708 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e14bd-0d22-4bac-9917-df4e8de21af7 None admin] PATH_INFO: `/v3/users` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:43.733557 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07e14bd-0d22-4bac-9917-df4e8de21af7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:43.733875 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07e14bd-0d22-4bac-9917-df4e8de21af7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:43.735411 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07e14bd-0d22-4bac-9917-df4e8de21af7 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:43.743058 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ca4de3-f9de-49d7-b3d5-bbb4c5d76fe1 None None] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:43.754142 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 331/681] 10.222.0.66 () {56 vars in 1133 bytes} [Mon Jul 25 21:22:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:22:43.759992 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07e14bd-0d22-4bac-9917-df4e8de21af7 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:43.790369 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab47189f-4c12-4758-8f81-1b486f757d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:43.791031 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab47189f-4c12-4758-8f81-1b486f757d23 None admin] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:43.791315 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab47189f-4c12-4758-8f81-1b486f757d23 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:43.791594 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab47189f-4c12-4758-8f81-1b486f757d23 None admin] PATH_INFO: `/v3/services` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:43.792627 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab47189f-4c12-4758-8f81-1b486f757d23 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:43.794307 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab47189f-4c12-4758-8f81-1b486f757d23 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:43.817648 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 351/682] 10.222.0.66 () {60 vars in 1141 bytes} [Mon Jul 25 21:22:43 2022] POST /identity/v3/services => generated 251 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 21:22:43.891638 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07e14bd-0d22-4bac-9917-df4e8de21af7 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:43.894640 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:43.945990 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac06b931-a237-42a3-b91c-2a1ba2407ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:43.946691 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac06b931-a237-42a3-b91c-2a1ba2407ccd None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:43.946974 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac06b931-a237-42a3-b91c-2a1ba2407ccd None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:43.947249 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac06b931-a237-42a3-b91c-2a1ba2407ccd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:43.960027 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac06b931-a237-42a3-b91c-2a1ba2407ccd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:43.961568 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac06b931-a237-42a3-b91c-2a1ba2407ccd None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:43.974733 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39da8f7-c84e-4002-affa-adcd66058a81 None None] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:43.975272 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39da8f7-c84e-4002-affa-adcd66058a81 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:43.975723 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39da8f7-c84e-4002-affa-adcd66058a81 None None] PATH_INFO: `/` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:43.977583 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 352/683] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:22:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 21:22:43.981136 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application [None req-ac06b931-a237-42a3-b91c-2a1ba2407ccd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:22:43.981136 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:22:43.981136 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:22:43.981136 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:22:43.981136 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:22:43.981136 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:22:43.981136 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:22:43.981136 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:22:43.981136 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:22:43.981136 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:22:43.981136 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:22:43.981136 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:22:43.981136 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:22:43.981136 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:22:43.981136 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:22:43.982430 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:22:43.982430 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:22:43.982430 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:22:43.982430 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:22:43.982430 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:22:43.982430 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:22:43.982430 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:22:43.982430 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:22:43.982430 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application with Lock( Jul 25 21:22:43.982430 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:22:43.982430 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:22:43.982430 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:22:43.982430 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:22:43.982430 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:22:43.982430 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:22:43.982430 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:22:43.982430 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:22:43.983564 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:22:43.983564 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:22:43.983564 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:22:43.983564 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Jul 25 21:22:43.983564 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 332/684] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 25 21:22:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 21:22:43.985113 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b5bda4-2919-46cc-bdcc-846f324a72a1 None None] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:43.985531 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b5bda4-2919-46cc-bdcc-846f324a72a1 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:43.985839 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac06b931-a237-42a3-b91c-2a1ba2407ccd None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:43.985951 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b5bda4-2919-46cc-bdcc-846f324a72a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:44.006735 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.auth.core [None req-14b5bda4-2919-46cc-bdcc-846f324a72a1 None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:22:44.008222 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-14b5bda4-2919-46cc-bdcc-846f324a72a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:22:44.105182 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 353/685] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:22:43 2022] POST /identity/v3/auth/tokens => generated 999 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:22:44.127262 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac06b931-a237-42a3-b91c-2a1ba2407ccd None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:44.143425 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b5bda4-2919-46cc-bdcc-846f324a72a1 None None] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:44.155849 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:44.185900 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027f3173-7660-46e3-b491-76244059dab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:44.186806 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027f3173-7660-46e3-b491-76244059dab2 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:44.187086 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027f3173-7660-46e3-b491-76244059dab2 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:44.187353 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027f3173-7660-46e3-b491-76244059dab2 None admin] PATH_INFO: `/v3/domains` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:44.188944 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027f3173-7660-46e3-b491-76244059dab2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:44.189412 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027f3173-7660-46e3-b491-76244059dab2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:44.190812 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027f3173-7660-46e3-b491-76244059dab2 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:44.207129 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 333/686] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Jul 25 21:22:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:44.212688 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027f3173-7660-46e3-b491-76244059dab2 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:44.228927 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:44.276049 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b5bda4-2919-46cc-bdcc-846f324a72a1 None None] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:44.317260 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e604195-007c-41ad-a413-83f6db486b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:44.317894 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e604195-007c-41ad-a413-83f6db486b5d None admin] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:44.318171 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e604195-007c-41ad-a413-83f6db486b5d None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:44.318441 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e604195-007c-41ad-a413-83f6db486b5d None admin] PATH_INFO: `/v3/services` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:44.319129 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e604195-007c-41ad-a413-83f6db486b5d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:44.320945 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e604195-007c-41ad-a413-83f6db486b5d None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:44.332712 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027f3173-7660-46e3-b491-76244059dab2 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:44.341111 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 354/687] 10.222.0.66 () {60 vars in 1141 bytes} [Mon Jul 25 21:22:44 2022] POST /identity/v3/services => generated 240 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 21:22:44.393371 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33d643b-9875-47b9-a6e2-dba2e705026c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:44.394464 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33d643b-9875-47b9-a6e2-dba2e705026c None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:44.394735 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33d643b-9875-47b9-a6e2-dba2e705026c None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:44.395493 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33d643b-9875-47b9-a6e2-dba2e705026c None admin] PATH_INFO: `/v3/projects/service` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:44.402715 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33d643b-9875-47b9-a6e2-dba2e705026c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:44.404196 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33d643b-9875-47b9-a6e2-dba2e705026c None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:44.418404 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application [None req-e33d643b-9875-47b9-a6e2-dba2e705026c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:22:44.418404 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:22:44.418404 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:22:44.418404 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:22:44.418404 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:22:44.418404 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:22:44.418404 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:22:44.418404 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:22:44.418404 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:22:44.418404 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:22:44.418404 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:22:44.418404 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:22:44.418404 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 21:22:44.418404 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 21:22:44.418404 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 21:22:44.419397 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 21:22:44.419397 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:22:44.419397 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:22:44.419397 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:22:44.419397 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:22:44.419397 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:22:44.419397 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:22:44.419397 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:22:44.419397 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application with Lock( Jul 25 21:22:44.419397 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:22:44.419397 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:22:44.419397 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:22:44.419397 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:22:44.419397 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:22:44.419397 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:22:44.419397 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:22:44.419397 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:22:44.420309 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 21:22:44.420309 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 21:22:44.420309 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 21:22:44.420309 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 21:22:44.420309 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 21:22:44.420309 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 21:22:44.420309 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:22:44.420309 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Jul 25 21:22:44.420309 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 334/688] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Jul 25 21:22:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:22:44.426303 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e604195-007c-41ad-a413-83f6db486b5d None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:44.507853 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:44.544341 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e604195-007c-41ad-a413-83f6db486b5d None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:44.581706 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe6f7ef-3511-4fcb-bd4f-2f8f11c1b427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:44.582318 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe6f7ef-3511-4fcb-bd4f-2f8f11c1b427 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:44.582593 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe6f7ef-3511-4fcb-bd4f-2f8f11c1b427 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:44.582860 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe6f7ef-3511-4fcb-bd4f-2f8f11c1b427 None admin] PATH_INFO: `/v3/projects` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:44.583614 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe6f7ef-3511-4fcb-bd4f-2f8f11c1b427 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:44.584015 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe6f7ef-3511-4fcb-bd4f-2f8f11c1b427 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:44.585498 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe6f7ef-3511-4fcb-bd4f-2f8f11c1b427 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:44.600495 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 355/689] 10.222.0.66 () {56 vars in 1148 bytes} [Mon Jul 25 21:22:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:44.606853 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33d643b-9875-47b9-a6e2-dba2e705026c None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:44.676462 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:44.720624 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33d643b-9875-47b9-a6e2-dba2e705026c None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:44.755377 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d9f015-55fe-4b31-8187-cc65b5a9c4a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:44.756064 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d9f015-55fe-4b31-8187-cc65b5a9c4a7 None admin] REQUEST_METHOD: `PUT` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:44.756341 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d9f015-55fe-4b31-8187-cc65b5a9c4a7 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:44.756620 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d9f015-55fe-4b31-8187-cc65b5a9c4a7 None admin] PATH_INFO: `/v3/projects/7e36d923af474a07adb12209580f12e1/users/524584f0d1b64e02a467b47de395c130/roles/216a86497a3a4593ba08730ea8697df3` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:44.758616 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d9f015-55fe-4b31-8187-cc65b5a9c4a7 None admin] RBAC: Authorizing `identity:create_grant(project_id=7e36d923af474a07adb12209580f12e1, user_id=524584f0d1b64e02a467b47de395c130, role_id=216a86497a3a4593ba08730ea8697df3)` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:44.760059 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d9f015-55fe-4b31-8187-cc65b5a9c4a7 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:44.776899 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 335/690] 10.222.0.66 () {58 vars in 1439 bytes} [Mon Jul 25 21:22:44 2022] PUT /identity/v3/projects/7e36d923af474a07adb12209580f12e1/users/524584f0d1b64e02a467b47de395c130/roles/216a86497a3a4593ba08730ea8697df3 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 21:22:44.836060 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e55de54-57fc-42ac-817c-cb81c9c10aff None None] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:44.836260 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e55de54-57fc-42ac-817c-cb81c9c10aff None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:44.836582 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e55de54-57fc-42ac-817c-cb81c9c10aff None None] PATH_INFO: `/` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:44.838773 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 356/691] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:22:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:22:44.849472 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35244104-c3cd-4e33-bcd7-2635ae297f7e None None] REQUEST_METHOD: `POST` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:44.849691 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35244104-c3cd-4e33-bcd7-2635ae297f7e None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:44.849820 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35244104-c3cd-4e33-bcd7-2635ae297f7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:44.871879 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.auth.core [None req-35244104-c3cd-4e33-bcd7-2635ae297f7e None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:22:44.873135 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.fernet_utils [None req-35244104-c3cd-4e33-bcd7-2635ae297f7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:22:44.953133 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 336/692] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:22:44 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 21:22:44.973288 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e55de54-57fc-42ac-817c-cb81c9c10aff None None] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:45.084543 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e55de54-57fc-42ac-817c-cb81c9c10aff None None] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:45.115583 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:45.122025 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14464f67-17e4-4ab0-8099-9ebb02ea9cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:45.122691 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14464f67-17e4-4ab0-8099-9ebb02ea9cc5 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:45.122968 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14464f67-17e4-4ab0-8099-9ebb02ea9cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:45.123239 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14464f67-17e4-4ab0-8099-9ebb02ea9cc5 None admin] PATH_INFO: `/v3/services/image` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:45.123861 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14464f67-17e4-4ab0-8099-9ebb02ea9cc5 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:45.125272 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14464f67-17e4-4ab0-8099-9ebb02ea9cc5 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:45.136816 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application [None req-14464f67-17e4-4ab0-8099-9ebb02ea9cc5 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 21:22:45.136816 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:22:45.136816 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 21:22:45.136816 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 21:22:45.136816 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 21:22:45.136816 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 21:22:45.136816 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 21:22:45.136816 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 21:22:45.136816 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 21:22:45.136816 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Jul 25 21:22:45.136816 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 21:22:45.136816 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Jul 25 21:22:45.136816 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:22:45.136816 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:22:45.136816 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:22:45.136816 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:22:45.136816 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:22:45.138005 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:22:45.138005 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:22:45.138005 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:22:45.138005 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:22:45.138005 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:22:45.138005 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:22:45.138005 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 21:22:45.138005 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 21:22:45.138005 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 21:22:45.138005 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 21:22:45.138005 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:22:45.138005 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:22:45.138005 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:22:45.138005 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:22:45.138005 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:22:45.138005 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:22:45.138865 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:22:45.138865 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application with Lock( Jul 25 21:22:45.138865 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:22:45.138865 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:22:45.138865 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:22:45.138865 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:22:45.138865 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:22:45.138865 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:22:45.138865 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:22:45.138865 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:22:45.138865 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 21:22:45.138865 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 21:22:45.138865 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 21:22:45.138865 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Jul 25 21:22:45.138865 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 357/693] 10.222.0.66 () {56 vars in 1105 bytes} [Mon Jul 25 21:22:44 2022] GET /identity/v3/services/image => generated 86 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:22:45.146635 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35244104-c3cd-4e33-bcd7-2635ae297f7e None None] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:45.207025 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:45.257992 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35244104-c3cd-4e33-bcd7-2635ae297f7e None None] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:45.293430 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77c91a2-ebf2-4a8b-8f49-0160300350c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:45.294426 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77c91a2-ebf2-4a8b-8f49-0160300350c8 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:45.294963 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77c91a2-ebf2-4a8b-8f49-0160300350c8 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:45.295437 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77c91a2-ebf2-4a8b-8f49-0160300350c8 None admin] PATH_INFO: `/v3/services` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:45.296367 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77c91a2-ebf2-4a8b-8f49-0160300350c8 None admin] RBAC: Adding query filter params (name=image) {{(pid=87210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:45.296894 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77c91a2-ebf2-4a8b-8f49-0160300350c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:45.298741 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77c91a2-ebf2-4a8b-8f49-0160300350c8 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:45.308526 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 337/694] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 25 21:22:45 2022] GET /identity/v3/services?name=image => generated 122 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:45.310306 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14464f67-17e4-4ab0-8099-9ebb02ea9cc5 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:45.412265 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14464f67-17e4-4ab0-8099-9ebb02ea9cc5 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:45.447095 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489fd980-c9b7-47af-82f4-e993e3080684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:45.448051 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489fd980-c9b7-47af-82f4-e993e3080684 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:45.448532 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489fd980-c9b7-47af-82f4-e993e3080684 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:45.449114 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489fd980-c9b7-47af-82f4-e993e3080684 None admin] PATH_INFO: `/v3/services` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:45.450095 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489fd980-c9b7-47af-82f4-e993e3080684 None admin] RBAC: Adding query filter params (type=image) {{(pid=87209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:45.450614 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489fd980-c9b7-47af-82f4-e993e3080684 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:45.452206 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489fd980-c9b7-47af-82f4-e993e3080684 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:45.462506 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 358/695] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 25 21:22:45 2022] GET /identity/v3/services?type=image => generated 350 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:22:45.464081 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77c91a2-ebf2-4a8b-8f49-0160300350c8 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:45.574980 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77c91a2-ebf2-4a8b-8f49-0160300350c8 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:45.600129 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:45.612832 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a331615-0f27-480f-9501-2c400206a31c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:45.613848 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a331615-0f27-480f-9501-2c400206a31c None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:45.614337 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a331615-0f27-480f-9501-2c400206a31c None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:45.614805 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a331615-0f27-480f-9501-2c400206a31c None admin] PATH_INFO: `/v3/endpoints` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:45.615790 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a331615-0f27-480f-9501-2c400206a31c None admin] RBAC: Adding query filter params (interface=public, service_id=a37ec5db08ef4c11b219c30fe0b49a87, region_id=RegionOne) {{(pid=87210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:45.616317 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a331615-0f27-480f-9501-2c400206a31c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:45.617941 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a331615-0f27-480f-9501-2c400206a31c None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:45.630694 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 338/696] 10.222.0.66 () {56 vars in 1251 bytes} [Mon Jul 25 21:22:45 2022] GET /identity/v3/endpoints?service_id=a37ec5db08ef4c11b219c30fe0b49a87&interface=public®ion_id=RegionOne => generated 194 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:45.633658 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489fd980-c9b7-47af-82f4-e993e3080684 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:45.694833 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:45.738417 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489fd980-c9b7-47af-82f4-e993e3080684 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:45.772494 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc6aaaa-af84-4062-881f-e163d9b0e454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:45.773143 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc6aaaa-af84-4062-881f-e163d9b0e454 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:45.773423 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc6aaaa-af84-4062-881f-e163d9b0e454 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:45.773690 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc6aaaa-af84-4062-881f-e163d9b0e454 None admin] PATH_INFO: `/v3/services` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:45.774330 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc6aaaa-af84-4062-881f-e163d9b0e454 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:45.775706 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc6aaaa-af84-4062-881f-e163d9b0e454 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:45.781688 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 359/697] 10.222.0.66 () {56 vars in 1087 bytes} [Mon Jul 25 21:22:45 2022] GET /identity/v3/services => generated 1002 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 21:22:46.237851 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f2352a-25bb-4841-8b2a-f5aef2377c56 None None] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:46.238376 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f2352a-25bb-4841-8b2a-f5aef2377c56 None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:46.238376 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f2352a-25bb-4841-8b2a-f5aef2377c56 None None] PATH_INFO: `/` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:46.239955 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 339/698] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:22:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:22:46.245191 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2357e0-8dfa-4c5b-8e26-9e7de6ad572a None None] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:46.245523 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2357e0-8dfa-4c5b-8e26-9e7de6ad572a None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:46.245800 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2357e0-8dfa-4c5b-8e26-9e7de6ad572a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:46.264018 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.auth.core [None req-2c2357e0-8dfa-4c5b-8e26-9e7de6ad572a None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:22:46.265249 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-2c2357e0-8dfa-4c5b-8e26-9e7de6ad572a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:22:46.337563 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 360/699] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:22:46 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 21:22:46.360760 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f2352a-25bb-4841-8b2a-f5aef2377c56 None None] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:46.469391 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f2352a-25bb-4841-8b2a-f5aef2377c56 None None] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:46.505007 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d325846d-28a7-427a-885b-e48523b06dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:46.506030 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d325846d-28a7-427a-885b-e48523b06dbc None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:46.506609 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d325846d-28a7-427a-885b-e48523b06dbc None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:46.507082 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d325846d-28a7-427a-885b-e48523b06dbc None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:46.507939 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d325846d-28a7-427a-885b-e48523b06dbc None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:46.509542 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d325846d-28a7-427a-885b-e48523b06dbc None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:46.522048 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application [None req-d325846d-28a7-427a-885b-e48523b06dbc None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 21:22:46.522048 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:22:46.522048 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 21:22:46.522048 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 21:22:46.522048 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 21:22:46.522048 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 21:22:46.522048 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 21:22:46.522048 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 21:22:46.522048 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 21:22:46.522048 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Jul 25 21:22:46.522048 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 21:22:46.522048 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Jul 25 21:22:46.522048 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:22:46.522048 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:22:46.522048 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:22:46.522048 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:22:46.523027 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:22:46.523027 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:22:46.523027 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:22:46.523027 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:22:46.523027 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:22:46.523027 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:22:46.523027 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:22:46.523027 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 21:22:46.523027 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 21:22:46.523027 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 21:22:46.523027 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 21:22:46.523027 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:22:46.523027 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:22:46.523027 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:22:46.523027 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:22:46.523027 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:22:46.523861 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:22:46.523861 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:22:46.523861 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application with Lock( Jul 25 21:22:46.523861 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:22:46.523861 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:22:46.523861 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:22:46.523861 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:22:46.523861 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:22:46.523861 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:22:46.523861 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:22:46.523861 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:22:46.523861 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 21:22:46.523861 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 21:22:46.523861 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 21:22:46.523861 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Jul 25 21:22:46.526917 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 340/700] 10.222.0.66 () {56 vars in 1129 bytes} [Mon Jul 25 21:22:46 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:22:46.537138 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2357e0-8dfa-4c5b-8e26-9e7de6ad572a None None] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:46.587054 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:46.639101 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2357e0-8dfa-4c5b-8e26-9e7de6ad572a None None] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:46.676413 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065420ab-06a3-47e9-973a-cba827713e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:46.677043 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065420ab-06a3-47e9-973a-cba827713e3f None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:46.677343 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065420ab-06a3-47e9-973a-cba827713e3f None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:46.677611 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065420ab-06a3-47e9-973a-cba827713e3f None admin] PATH_INFO: `/v3/services` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:46.678279 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065420ab-06a3-47e9-973a-cba827713e3f None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:46.678578 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065420ab-06a3-47e9-973a-cba827713e3f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:46.679951 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065420ab-06a3-47e9-973a-cba827713e3f None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:46.684991 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 361/701] 10.222.0.66 () {56 vars in 1124 bytes} [Mon Jul 25 21:22:46 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:46.690342 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d325846d-28a7-427a-885b-e48523b06dbc None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:46.744367 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:46.783358 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ce6b5c-5ff2-4c79-96e4-f9e079186342 None None] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:46.783823 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ce6b5c-5ff2-4c79-96e4-f9e079186342 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:46.784165 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ce6b5c-5ff2-4c79-96e4-f9e079186342 None None] PATH_INFO: `/` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:46.785617 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 362/702] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:22:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:22:46.791372 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99898965-b78b-45d3-a388-46a58664a8f5 None None] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:46.791648 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99898965-b78b-45d3-a388-46a58664a8f5 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:46.792022 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99898965-b78b-45d3-a388-46a58664a8f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:46.799386 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d325846d-28a7-427a-885b-e48523b06dbc None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:46.812810 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.auth.core [None req-99898965-b78b-45d3-a388-46a58664a8f5 None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:22:46.814036 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-99898965-b78b-45d3-a388-46a58664a8f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:22:46.835992 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7525e6ff-698c-435f-8de8-a7fc78cee75f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:46.836900 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7525e6ff-698c-435f-8de8-a7fc78cee75f None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:46.837355 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7525e6ff-698c-435f-8de8-a7fc78cee75f None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:46.837765 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7525e6ff-698c-435f-8de8-a7fc78cee75f None admin] PATH_INFO: `/v3/services` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:46.838591 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7525e6ff-698c-435f-8de8-a7fc78cee75f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:46.839069 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7525e6ff-698c-435f-8de8-a7fc78cee75f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:46.840691 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7525e6ff-698c-435f-8de8-a7fc78cee75f None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:46.846237 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 341/703] 10.222.0.66 () {56 vars in 1124 bytes} [Mon Jul 25 21:22:46 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:46.851961 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7525e6ff-698c-435f-8de8-a7fc78cee75f None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:46.897239 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 363/704] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:22:46 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 21:22:46.914298 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99898965-b78b-45d3-a388-46a58664a8f5 None None] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:46.958983 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7525e6ff-698c-435f-8de8-a7fc78cee75f None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:46.974532 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:46.998441 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ef0ee3-cb92-47f4-a686-b21184af35c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:46.999074 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ef0ee3-cb92-47f4-a686-b21184af35c3 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:46.999690 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ef0ee3-cb92-47f4-a686-b21184af35c3 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:46.999972 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ef0ee3-cb92-47f4-a686-b21184af35c3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:47.000872 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ef0ee3-cb92-47f4-a686-b21184af35c3 None admin] RBAC: Adding query filter params (interface=public, service_id=3471636724f541f7961a764e8bebe98e, region_id=RegionOne) {{(pid=87210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:47.001326 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ef0ee3-cb92-47f4-a686-b21184af35c3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:47.002950 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ef0ee3-cb92-47f4-a686-b21184af35c3 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:47.013188 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 342/705] 10.222.0.66 () {56 vars in 1251 bytes} [Mon Jul 25 21:22:46 2022] GET /identity/v3/endpoints?service_id=3471636724f541f7961a764e8bebe98e&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:22:47.013633 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:47.017536 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ef0ee3-cb92-47f4-a686-b21184af35c3 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:47.055182 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99898965-b78b-45d3-a388-46a58664a8f5 None None] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:47.092350 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2edaf3-52dc-4bd2-8eb1-30305986b3d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:47.093452 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2edaf3-52dc-4bd2-8eb1-30305986b3d8 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:47.094010 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2edaf3-52dc-4bd2-8eb1-30305986b3d8 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:47.094596 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2edaf3-52dc-4bd2-8eb1-30305986b3d8 None admin] PATH_INFO: `/v3/services/network` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:47.095510 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2edaf3-52dc-4bd2-8eb1-30305986b3d8 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:47.097625 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2edaf3-52dc-4bd2-8eb1-30305986b3d8 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:47.107284 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application [None req-5f2edaf3-52dc-4bd2-8eb1-30305986b3d8 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 21:22:47.107284 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:22:47.107284 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 21:22:47.107284 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 21:22:47.107284 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 21:22:47.107284 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 21:22:47.107284 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 21:22:47.107284 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 21:22:47.107284 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 21:22:47.107284 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Jul 25 21:22:47.107284 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 21:22:47.107284 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Jul 25 21:22:47.107284 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:22:47.107284 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:22:47.107284 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:22:47.107284 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:22:47.107284 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:22:47.108367 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:22:47.108367 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:22:47.108367 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:22:47.108367 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:22:47.108367 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:22:47.108367 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:22:47.108367 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 21:22:47.108367 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 21:22:47.108367 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 21:22:47.108367 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 21:22:47.108367 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:22:47.108367 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:22:47.108367 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:22:47.108367 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:22:47.108367 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:22:47.108367 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:22:47.109239 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:22:47.109239 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application with Lock( Jul 25 21:22:47.109239 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:22:47.109239 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:22:47.109239 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:22:47.109239 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:22:47.109239 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:22:47.109239 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:22:47.109239 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:22:47.109239 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:22:47.109239 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 21:22:47.109239 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 21:22:47.109239 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 21:22:47.109239 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Jul 25 21:22:47.116854 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 364/706] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Jul 25 21:22:46 2022] GET /identity/v3/services/network => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 21:22:47.118075 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2edaf3-52dc-4bd2-8eb1-30305986b3d8 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:47.147315 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ef0ee3-cb92-47f4-a686-b21184af35c3 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:47.192496 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e791b14-dd1f-472b-afd9-9df48f8fb79e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:47.193155 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e791b14-dd1f-472b-afd9-9df48f8fb79e None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:47.193438 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e791b14-dd1f-472b-afd9-9df48f8fb79e None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:47.193707 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e791b14-dd1f-472b-afd9-9df48f8fb79e None admin] PATH_INFO: `/v3/services` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:47.194366 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e791b14-dd1f-472b-afd9-9df48f8fb79e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:47.195750 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e791b14-dd1f-472b-afd9-9df48f8fb79e None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:47.205663 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 343/707] 10.222.0.66 () {56 vars in 1087 bytes} [Mon Jul 25 21:22:47 2022] GET /identity/v3/services => generated 1002 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 21:22:47.207397 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae5e25f-7f09-4dc4-8a80-88c80ff52e4c None None] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:47.207751 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae5e25f-7f09-4dc4-8a80-88c80ff52e4c None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:47.208262 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae5e25f-7f09-4dc4-8a80-88c80ff52e4c None None] PATH_INFO: `/` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:47.210370 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 344/708] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:22:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:22:47.216228 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3f3322-5abe-49df-bbde-7c78e0049e00 None None] REQUEST_METHOD: `POST` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:47.216527 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3f3322-5abe-49df-bbde-7c78e0049e00 None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:47.216777 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3f3322-5abe-49df-bbde-7c78e0049e00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:47.238871 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.auth.core [None req-5d3f3322-5abe-49df-bbde-7c78e0049e00 None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:22:47.240131 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.fernet_utils [None req-5d3f3322-5abe-49df-bbde-7c78e0049e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:22:47.242520 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2edaf3-52dc-4bd2-8eb1-30305986b3d8 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:47.255749 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:47.280178 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:47.289183 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f0a351-0fba-445e-b992-3138f85d9076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:47.290201 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f0a351-0fba-445e-b992-3138f85d9076 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:47.290483 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f0a351-0fba-445e-b992-3138f85d9076 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:47.290757 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f0a351-0fba-445e-b992-3138f85d9076 None admin] PATH_INFO: `/v3/services` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:47.291441 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f0a351-0fba-445e-b992-3138f85d9076 None admin] RBAC: Adding query filter params (name=network) {{(pid=87209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:47.291743 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f0a351-0fba-445e-b992-3138f85d9076 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:47.293188 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f0a351-0fba-445e-b992-3138f85d9076 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:47.299908 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 365/709] 10.222.0.66 () {56 vars in 1112 bytes} [Mon Jul 25 21:22:47 2022] GET /identity/v3/services?name=network => generated 124 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:47.307363 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f0a351-0fba-445e-b992-3138f85d9076 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:47.334637 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 345/710] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:22:47 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 21:22:47.359963 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3f3322-5abe-49df-bbde-7c78e0049e00 None None] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:47.437288 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f0a351-0fba-445e-b992-3138f85d9076 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:47.474354 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6968cbc-508e-414a-aebc-cecc8596207d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:47.474987 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6968cbc-508e-414a-aebc-cecc8596207d None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:47.475266 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6968cbc-508e-414a-aebc-cecc8596207d None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:47.475582 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6968cbc-508e-414a-aebc-cecc8596207d None admin] PATH_INFO: `/v3/services` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:47.476195 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6968cbc-508e-414a-aebc-cecc8596207d None admin] RBAC: Adding query filter params (type=network) {{(pid=87209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:47.476492 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6968cbc-508e-414a-aebc-cecc8596207d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:47.477894 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6968cbc-508e-414a-aebc-cecc8596207d None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:47.483045 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3f3322-5abe-49df-bbde-7c78e0049e00 None None] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:47.488134 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 366/711] 10.222.0.66 () {56 vars in 1112 bytes} [Mon Jul 25 21:22:47 2022] GET /identity/v3/services?type=network => generated 350 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:47.489186 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6968cbc-508e-414a-aebc-cecc8596207d None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:47.521994 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ad591e-c286-4051-a0e5-dff80a6ccd26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:47.523036 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ad591e-c286-4051-a0e5-dff80a6ccd26 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:47.523509 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ad591e-c286-4051-a0e5-dff80a6ccd26 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:47.523973 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ad591e-c286-4051-a0e5-dff80a6ccd26 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:47.532480 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:47.536083 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ad591e-c286-4051-a0e5-dff80a6ccd26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:22:47.541707 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application [None req-98ad591e-c286-4051-a0e5-dff80a6ccd26 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 21:22:47.541707 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:22:47.541707 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:22:47.541707 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:22:47.541707 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:22:47.541707 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:22:47.541707 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:22:47.541707 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:22:47.541707 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:22:47.541707 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:22:47.541707 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:22:47.541707 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:22:47.541707 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:22:47.541707 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:22:47.541707 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:22:47.541707 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:22:47.542635 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:22:47.542635 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:22:47.542635 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:22:47.542635 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:22:47.542635 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:22:47.542635 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:22:47.542635 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:22:47.542635 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:22:47.542635 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:22:47.542635 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:22:47.542635 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:22:47.542635 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application with Lock( Jul 25 21:22:47.542635 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:22:47.542635 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:22:47.542635 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:22:47.542635 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:22:47.543457 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:22:47.543457 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:22:47.543457 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:22:47.543457 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:22:47.543457 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:22:47.543457 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:22:47.543457 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:22:47.543457 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:22:47.543457 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:22:47.543457 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:22:47.543457 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 21:22:47.543457 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Jul 25 21:22:47.546128 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 346/712] 10.222.0.66 () {56 vars in 1096 bytes} [Mon Jul 25 21:22:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 21:22:47.552176 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ad591e-c286-4051-a0e5-dff80a6ccd26 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:47.587515 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:47.601503 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6968cbc-508e-414a-aebc-cecc8596207d None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:47.638726 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0853772-863e-47ef-92ac-bee154e49e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:47.639324 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0853772-863e-47ef-92ac-bee154e49e99 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:47.639602 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0853772-863e-47ef-92ac-bee154e49e99 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:47.639871 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0853772-863e-47ef-92ac-bee154e49e99 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:47.640623 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0853772-863e-47ef-92ac-bee154e49e99 None admin] RBAC: Adding query filter params (interface=public, service_id=40c265259d824b3798e1393f37caa988, region_id=RegionOne) {{(pid=87209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:47.640928 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0853772-863e-47ef-92ac-bee154e49e99 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:47.642557 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0853772-863e-47ef-92ac-bee154e49e99 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:47.655005 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 367/713] 10.222.0.66 () {56 vars in 1251 bytes} [Mon Jul 25 21:22:47 2022] GET /identity/v3/endpoints?service_id=40c265259d824b3798e1393f37caa988&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:47.656125 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0853772-863e-47ef-92ac-bee154e49e99 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:47.665217 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ad591e-c286-4051-a0e5-dff80a6ccd26 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:47.701349 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f02571-8885-4b70-8bef-fdeb77761578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:47.702314 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f02571-8885-4b70-8bef-fdeb77761578 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:47.702767 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f02571-8885-4b70-8bef-fdeb77761578 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:47.703272 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f02571-8885-4b70-8bef-fdeb77761578 None admin] PATH_INFO: `/v3/roles` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:47.704268 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f02571-8885-4b70-8bef-fdeb77761578 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:47.704816 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f02571-8885-4b70-8bef-fdeb77761578 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:47.706517 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f02571-8885-4b70-8bef-fdeb77761578 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:47.720710 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 347/714] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Jul 25 21:22:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:47.722034 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f02571-8885-4b70-8bef-fdeb77761578 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:47.764131 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0853772-863e-47ef-92ac-bee154e49e99 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:47.765695 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:47.802135 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22090488-ed89-40ed-a148-f9710e3a05c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:47.802769 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22090488-ed89-40ed-a148-f9710e3a05c6 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:47.803045 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22090488-ed89-40ed-a148-f9710e3a05c6 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:47.803315 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22090488-ed89-40ed-a148-f9710e3a05c6 None admin] PATH_INFO: `/v3/services` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:47.803963 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22090488-ed89-40ed-a148-f9710e3a05c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:47.805361 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22090488-ed89-40ed-a148-f9710e3a05c6 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:47.817207 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 368/715] 10.222.0.66 () {56 vars in 1087 bytes} [Mon Jul 25 21:22:47 2022] GET /identity/v3/services => generated 1002 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 21:22:47.829343 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:47.838638 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f02571-8885-4b70-8bef-fdeb77761578 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:47.878106 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f1da68-0a58-4cdb-ac6b-a514acea4534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:47.879385 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f1da68-0a58-4cdb-ac6b-a514acea4534 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:47.879952 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f1da68-0a58-4cdb-ac6b-a514acea4534 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:47.880442 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f1da68-0a58-4cdb-ac6b-a514acea4534 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:47.894130 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f1da68-0a58-4cdb-ac6b-a514acea4534 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:47.896094 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f1da68-0a58-4cdb-ac6b-a514acea4534 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:47.913016 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application [None req-e8f1da68-0a58-4cdb-ac6b-a514acea4534 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:22:47.913016 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:22:47.913016 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:22:47.913016 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:22:47.913016 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:22:47.913016 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:22:47.913016 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:22:47.913016 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:22:47.913016 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:22:47.913016 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:22:47.913016 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:22:47.913016 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:22:47.913016 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:22:47.913016 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:22:47.913016 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:22:47.914013 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:22:47.914013 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:22:47.914013 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:22:47.914013 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:22:47.914013 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:22:47.914013 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:22:47.914013 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:22:47.914013 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:22:47.914013 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application with Lock( Jul 25 21:22:47.914013 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:22:47.914013 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:22:47.914013 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:22:47.914013 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:22:47.914013 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:22:47.914013 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:22:47.914013 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:22:47.914013 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:22:47.915228 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:22:47.915228 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:22:47.915228 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:22:47.915228 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Jul 25 21:22:47.917706 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 348/716] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 25 21:22:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:22:47.924264 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22090488-ed89-40ed-a148-f9710e3a05c6 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:48.050689 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22090488-ed89-40ed-a148-f9710e3a05c6 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:48.086662 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7993d154-c437-4f70-975f-ba85f9d4c8b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:48.087354 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7993d154-c437-4f70-975f-ba85f9d4c8b9 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:48.087631 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7993d154-c437-4f70-975f-ba85f9d4c8b9 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:48.087901 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7993d154-c437-4f70-975f-ba85f9d4c8b9 None admin] PATH_INFO: `/v3/domains` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:48.088598 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7993d154-c437-4f70-975f-ba85f9d4c8b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:48.088952 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7993d154-c437-4f70-975f-ba85f9d4c8b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:48.090345 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7993d154-c437-4f70-975f-ba85f9d4c8b9 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:48.104718 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 369/717] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Jul 25 21:22:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:48.110753 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f1da68-0a58-4cdb-ac6b-a514acea4534 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:48.158225 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a68d2a-8a87-43b0-b13b-0c3b5d3d726c None None] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:48.158464 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a68d2a-8a87-43b0-b13b-0c3b5d3d726c None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:48.158931 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a68d2a-8a87-43b0-b13b-0c3b5d3d726c None None] PATH_INFO: `/` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:48.162523 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 370/718] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:22:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:22:48.167942 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cec1bfa-cdab-4092-b5cf-1c254e568219 None None] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:48.168425 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cec1bfa-cdab-4092-b5cf-1c254e568219 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:48.168900 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cec1bfa-cdab-4092-b5cf-1c254e568219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:48.193251 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.auth.core [None req-1cec1bfa-cdab-4092-b5cf-1c254e568219 None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:22:48.194494 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-1cec1bfa-cdab-4092-b5cf-1c254e568219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:22:48.216170 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:48.218675 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f1da68-0a58-4cdb-ac6b-a514acea4534 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:48.253950 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798d5f19-defd-430c-a445-c96e3bc5a287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:48.254628 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798d5f19-defd-430c-a445-c96e3bc5a287 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:48.254628 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798d5f19-defd-430c-a445-c96e3bc5a287 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:48.254769 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798d5f19-defd-430c-a445-c96e3bc5a287 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:48.262934 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798d5f19-defd-430c-a445-c96e3bc5a287 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:48.264526 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798d5f19-defd-430c-a445-c96e3bc5a287 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:48.269545 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 371/719] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:22:48 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 21:22:48.279307 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application [None req-798d5f19-defd-430c-a445-c96e3bc5a287 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 21:22:48.279307 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:22:48.279307 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:22:48.279307 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:22:48.279307 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:22:48.279307 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:22:48.279307 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:22:48.279307 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:22:48.279307 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:22:48.279307 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:22:48.279307 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:22:48.279307 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:22:48.279307 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 21:22:48.279307 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 21:22:48.279307 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 21:22:48.279307 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 21:22:48.280236 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:22:48.280236 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:22:48.280236 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 21:22:48.280236 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:22:48.280236 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 21:22:48.280236 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:22:48.280236 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:22:48.280236 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:22:48.280236 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:22:48.280236 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:22:48.280236 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:22:48.280236 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application with Lock( Jul 25 21:22:48.280236 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:22:48.280236 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:22:48.280236 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:22:48.280236 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:22:48.280236 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:22:48.280236 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:22:48.281263 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:22:48.281263 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:22:48.281263 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 21:22:48.281263 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 21:22:48.281263 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 21:22:48.281263 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 21:22:48.281263 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 21:22:48.281263 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 21:22:48.281263 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 21:22:48.281263 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Jul 25 21:22:48.281263 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 349/720] 10.222.0.66 () {56 vars in 1093 bytes} [Mon Jul 25 21:22:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:22:48.284420 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cec1bfa-cdab-4092-b5cf-1c254e568219 None None] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:48.293710 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798d5f19-defd-430c-a445-c96e3bc5a287 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:48.305149 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:48.415652 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798d5f19-defd-430c-a445-c96e3bc5a287 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:48.420138 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cec1bfa-cdab-4092-b5cf-1c254e568219 None None] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:48.454146 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bcec75-e63f-459e-be2d-115fb723d14a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:48.454859 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bcec75-e63f-459e-be2d-115fb723d14a None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:48.455154 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bcec75-e63f-459e-be2d-115fb723d14a None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:48.455430 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bcec75-e63f-459e-be2d-115fb723d14a None admin] PATH_INFO: `/v3/services/image` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:48.456129 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bcec75-e63f-459e-be2d-115fb723d14a None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:48.457960 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bcec75-e63f-459e-be2d-115fb723d14a None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:48.459551 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1136fe12-73ab-4fc4-91fe-a72d74ac0cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:48.461229 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1136fe12-73ab-4fc4-91fe-a72d74ac0cf6 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:48.461699 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1136fe12-73ab-4fc4-91fe-a72d74ac0cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:48.462171 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1136fe12-73ab-4fc4-91fe-a72d74ac0cf6 None admin] PATH_INFO: `/v3/users` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:48.463165 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1136fe12-73ab-4fc4-91fe-a72d74ac0cf6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:48.463660 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1136fe12-73ab-4fc4-91fe-a72d74ac0cf6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:48.465315 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1136fe12-73ab-4fc4-91fe-a72d74ac0cf6 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:48.467323 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application [None req-84bcec75-e63f-459e-be2d-115fb723d14a None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 21:22:48.467323 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:22:48.467323 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 21:22:48.467323 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 21:22:48.467323 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 21:22:48.467323 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 21:22:48.467323 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 21:22:48.467323 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 21:22:48.467323 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 21:22:48.467323 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Jul 25 21:22:48.467323 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 21:22:48.467323 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Jul 25 21:22:48.467323 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:22:48.467323 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:22:48.467323 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:22:48.467323 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:22:48.467323 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:22:48.468291 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:22:48.468291 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:22:48.468291 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:22:48.468291 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:22:48.468291 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:22:48.468291 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:22:48.468291 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 21:22:48.468291 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 21:22:48.468291 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 21:22:48.468291 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 21:22:48.468291 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:22:48.468291 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:22:48.468291 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:22:48.468291 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:22:48.468291 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:22:48.468291 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:22:48.469163 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:22:48.469163 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application with Lock( Jul 25 21:22:48.469163 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:22:48.469163 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:22:48.469163 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:22:48.469163 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:22:48.469163 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:22:48.469163 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:22:48.469163 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:22:48.469163 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:22:48.469163 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 21:22:48.469163 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 21:22:48.469163 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 21:22:48.469163 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Jul 25 21:22:48.469163 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 350/721] 10.222.0.66 () {56 vars in 1105 bytes} [Mon Jul 25 21:22:48 2022] GET /identity/v3/services/image => generated 86 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 21:22:48.475758 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bcec75-e63f-459e-be2d-115fb723d14a None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:48.493201 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 372/722] 10.222.0.66 () {56 vars in 1133 bytes} [Mon Jul 25 21:22:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:22:48.496102 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1136fe12-73ab-4fc4-91fe-a72d74ac0cf6 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:48.517870 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:48.571406 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:48.605506 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bcec75-e63f-459e-be2d-115fb723d14a None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:48.620083 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1136fe12-73ab-4fc4-91fe-a72d74ac0cf6 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:48.642730 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffe13fb-4cfc-44ee-ae06-e0f8252cd9d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:48.643637 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffe13fb-4cfc-44ee-ae06-e0f8252cd9d1 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:48.643970 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffe13fb-4cfc-44ee-ae06-e0f8252cd9d1 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:48.644246 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffe13fb-4cfc-44ee-ae06-e0f8252cd9d1 None admin] PATH_INFO: `/v3/services` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:48.644962 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffe13fb-4cfc-44ee-ae06-e0f8252cd9d1 None admin] RBAC: Adding query filter params (name=image) {{(pid=87210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:48.645292 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffe13fb-4cfc-44ee-ae06-e0f8252cd9d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:48.646700 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffe13fb-4cfc-44ee-ae06-e0f8252cd9d1 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:48.652025 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 351/723] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 25 21:22:48 2022] GET /identity/v3/services?name=image => generated 122 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:48.659951 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffe13fb-4cfc-44ee-ae06-e0f8252cd9d1 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:48.668327 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a848e6-2192-49c8-93f7-92e5f06ac3d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:48.668892 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a848e6-2192-49c8-93f7-92e5f06ac3d2 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:48.669233 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a848e6-2192-49c8-93f7-92e5f06ac3d2 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:48.669516 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a848e6-2192-49c8-93f7-92e5f06ac3d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:48.744796 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a848e6-2192-49c8-93f7-92e5f06ac3d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:48.746288 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a848e6-2192-49c8-93f7-92e5f06ac3d2 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:48.762990 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:48.787119 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffe13fb-4cfc-44ee-ae06-e0f8252cd9d1 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:48.829372 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a0663c-92ad-4315-9a84-a50837242186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:48.830734 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a0663c-92ad-4315-9a84-a50837242186 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:48.831469 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a0663c-92ad-4315-9a84-a50837242186 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:48.831944 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a0663c-92ad-4315-9a84-a50837242186 None admin] PATH_INFO: `/v3/services` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:48.833006 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a0663c-92ad-4315-9a84-a50837242186 None admin] RBAC: Adding query filter params (type=image) {{(pid=87210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:48.833900 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a0663c-92ad-4315-9a84-a50837242186 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:48.835788 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a0663c-92ad-4315-9a84-a50837242186 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:48.843719 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:48.847317 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 352/724] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 25 21:22:48 2022] GET /identity/v3/services?type=image => generated 350 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:48.848544 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a0663c-92ad-4315-9a84-a50837242186 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:48.862917 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 373/725] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Jul 25 21:22:48 2022] GET /identity/v3/auth/tokens => generated 1098 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 25 21:22:48.864048 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a848e6-2192-49c8-93f7-92e5f06ac3d2 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:48.974155 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a0663c-92ad-4315-9a84-a50837242186 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:48.984382 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a848e6-2192-49c8-93f7-92e5f06ac3d2 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:49.003009 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:49.016463 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd36588f-73b8-4c88-8df0-0ee84d61c2de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:49.017442 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd36588f-73b8-4c88-8df0-0ee84d61c2de None admin] REQUEST_METHOD: `POST` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:49.017959 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd36588f-73b8-4c88-8df0-0ee84d61c2de None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:49.018622 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd36588f-73b8-4c88-8df0-0ee84d61c2de None admin] PATH_INFO: `/v3/endpoints` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:49.019846 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd36588f-73b8-4c88-8df0-0ee84d61c2de None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:49.022395 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd36588f-73b8-4c88-8df0-0ee84d61c2de None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:49.026391 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886b57a3-70b3-4441-b017-f3bc4aea2aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:49.027139 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886b57a3-70b3-4441-b017-f3bc4aea2aae None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:49.027414 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886b57a3-70b3-4441-b017-f3bc4aea2aae None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:49.027681 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886b57a3-70b3-4441-b017-f3bc4aea2aae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:49.040566 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886b57a3-70b3-4441-b017-f3bc4aea2aae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:49.042135 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886b57a3-70b3-4441-b017-f3bc4aea2aae None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:49.053857 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 353/726] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Jul 25 21:22:48 2022] POST /identity/v3/endpoints => generated 327 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 21:22:49.063263 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application [None req-886b57a3-70b3-4441-b017-f3bc4aea2aae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:22:49.063263 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:22:49.063263 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:22:49.063263 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:22:49.063263 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:22:49.063263 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:22:49.063263 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:22:49.063263 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:22:49.063263 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:22:49.063263 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:22:49.063263 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:22:49.063263 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:22:49.063263 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:22:49.063263 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:22:49.063263 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:22:49.064366 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:22:49.064366 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:22:49.064366 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:22:49.064366 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:22:49.064366 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:22:49.064366 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:22:49.064366 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:22:49.064366 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:22:49.064366 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application with Lock( Jul 25 21:22:49.064366 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:22:49.064366 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:22:49.064366 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:22:49.064366 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:22:49.064366 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:22:49.064366 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:22:49.064366 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:22:49.064366 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:22:49.065552 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:22:49.065552 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:22:49.065552 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:22:49.065552 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Jul 25 21:22:49.068021 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 374/727] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 25 21:22:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:22:49.074908 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd36588f-73b8-4c88-8df0-0ee84d61c2de None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:49.146669 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:49.209115 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd36588f-73b8-4c88-8df0-0ee84d61c2de None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:49.247236 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353c4f14-3cc6-4660-beec-767333ea0a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:49.248238 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353c4f14-3cc6-4660-beec-767333ea0a51 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:49.248663 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353c4f14-3cc6-4660-beec-767333ea0a51 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:49.249076 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353c4f14-3cc6-4660-beec-767333ea0a51 None admin] PATH_INFO: `/v3/domains` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:49.249919 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353c4f14-3cc6-4660-beec-767333ea0a51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:49.250234 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353c4f14-3cc6-4660-beec-767333ea0a51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:49.251666 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353c4f14-3cc6-4660-beec-767333ea0a51 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:49.265687 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 354/728] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Jul 25 21:22:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:49.272118 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886b57a3-70b3-4441-b017-f3bc4aea2aae None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:49.384106 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886b57a3-70b3-4441-b017-f3bc4aea2aae None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:49.426830 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15813bdd-ff22-4540-a641-4053512fa4e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:49.427883 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15813bdd-ff22-4540-a641-4053512fa4e8 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:49.428395 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15813bdd-ff22-4540-a641-4053512fa4e8 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:49.428992 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15813bdd-ff22-4540-a641-4053512fa4e8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:49.437381 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15813bdd-ff22-4540-a641-4053512fa4e8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:49.439294 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15813bdd-ff22-4540-a641-4053512fa4e8 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:49.452119 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application [None req-15813bdd-ff22-4540-a641-4053512fa4e8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:22:49.452119 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:22:49.452119 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:22:49.452119 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:22:49.452119 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:22:49.452119 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:22:49.452119 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:22:49.452119 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:22:49.452119 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:22:49.452119 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:22:49.452119 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:22:49.452119 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:22:49.452119 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 21:22:49.452119 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 21:22:49.452119 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 21:22:49.453016 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 21:22:49.453016 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:22:49.453016 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:22:49.453016 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:22:49.453016 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:22:49.453016 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:22:49.453016 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:22:49.453016 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:22:49.453016 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application with Lock( Jul 25 21:22:49.453016 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:22:49.453016 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:22:49.453016 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:22:49.453016 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:22:49.453016 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:22:49.453016 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:22:49.453016 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:22:49.453016 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:22:49.454030 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 21:22:49.454030 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 21:22:49.454030 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 21:22:49.454030 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 21:22:49.454030 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 21:22:49.454030 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 21:22:49.454030 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:22:49.454030 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Jul 25 21:22:49.456520 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 375/729] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Jul 25 21:22:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:22:49.462695 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353c4f14-3cc6-4660-beec-767333ea0a51 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:49.544674 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f55b8d-b21b-410a-9a82-976c1a56e187 None None] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:49.545308 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f55b8d-b21b-410a-9a82-976c1a56e187 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:49.545308 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f55b8d-b21b-410a-9a82-976c1a56e187 None None] PATH_INFO: `/` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:49.546921 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 376/730] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:22:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 21:22:49.552037 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c097bd6d-1bcf-4a1f-9227-49a4220527b6 None None] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:49.552311 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c097bd6d-1bcf-4a1f-9227-49a4220527b6 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:49.552585 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c097bd6d-1bcf-4a1f-9227-49a4220527b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:49.573230 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.auth.core [None req-c097bd6d-1bcf-4a1f-9227-49a4220527b6 None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:22:49.574442 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-c097bd6d-1bcf-4a1f-9227-49a4220527b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:22:49.582303 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353c4f14-3cc6-4660-beec-767333ea0a51 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:49.595658 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:49.597607 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:49.622334 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25749b0-99fe-4012-8019-c8b1af3847ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:49.623207 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25749b0-99fe-4012-8019-c8b1af3847ba None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:49.623680 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25749b0-99fe-4012-8019-c8b1af3847ba None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:49.624108 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25749b0-99fe-4012-8019-c8b1af3847ba None admin] PATH_INFO: `/v3/projects` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:49.624993 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25749b0-99fe-4012-8019-c8b1af3847ba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:49.625484 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25749b0-99fe-4012-8019-c8b1af3847ba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:49.627199 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25749b0-99fe-4012-8019-c8b1af3847ba None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:49.639736 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 355/731] 10.222.0.66 () {56 vars in 1148 bytes} [Mon Jul 25 21:22:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:22:49.646121 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25749b0-99fe-4012-8019-c8b1af3847ba None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:49.657740 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 377/732] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:22:49 2022] POST /identity/v3/auth/tokens => generated 1247 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 21:22:49.682129 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c097bd6d-1bcf-4a1f-9227-49a4220527b6 None None] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:49.751065 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25749b0-99fe-4012-8019-c8b1af3847ba None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:49.785776 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb528cf7-5e2d-4531-be7d-c25c166d547d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:49.786992 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb528cf7-5e2d-4531-be7d-c25c166d547d None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:49.787470 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb528cf7-5e2d-4531-be7d-c25c166d547d None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:49.787982 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb528cf7-5e2d-4531-be7d-c25c166d547d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:49.788954 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb528cf7-5e2d-4531-be7d-c25c166d547d None admin] RBAC: Adding query filter params (role.id=216a86497a3a4593ba08730ea8697df3, scope.project.id=7e36d923af474a07adb12209580f12e1, user.id=524584f0d1b64e02a467b47de395c130) {{(pid=87210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:49.789485 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb528cf7-5e2d-4531-be7d-c25c166d547d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:49.791452 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb528cf7-5e2d-4531-be7d-c25c166d547d None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:49.792685 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c097bd6d-1bcf-4a1f-9227-49a4220527b6 None None] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:49.798968 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 356/733] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Jul 25 21:22:49 2022] GET /identity/v3/role_assignments?user.id=524584f0d1b64e02a467b47de395c130&scope.project.id=7e36d923af474a07adb12209580f12e1&role.id=216a86497a3a4593ba08730ea8697df3 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:49.833747 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1ec0c1-775a-4715-8375-1f0b6a3f9a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:49.834426 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1ec0c1-775a-4715-8375-1f0b6a3f9a24 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:49.834704 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1ec0c1-775a-4715-8375-1f0b6a3f9a24 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:49.834977 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1ec0c1-775a-4715-8375-1f0b6a3f9a24 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:49.835613 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1ec0c1-775a-4715-8375-1f0b6a3f9a24 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:49.837015 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1ec0c1-775a-4715-8375-1f0b6a3f9a24 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:49.847615 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application [None req-cb1ec0c1-775a-4715-8375-1f0b6a3f9a24 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 21:22:49.847615 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:22:49.847615 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 21:22:49.847615 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 21:22:49.847615 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 21:22:49.847615 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 21:22:49.847615 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 21:22:49.847615 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 21:22:49.847615 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 21:22:49.847615 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Jul 25 21:22:49.847615 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 21:22:49.847615 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Jul 25 21:22:49.847615 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:22:49.847615 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:22:49.847615 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:22:49.847615 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:22:49.848653 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:22:49.848653 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:22:49.848653 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:22:49.848653 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:22:49.848653 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:22:49.848653 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:22:49.848653 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:22:49.848653 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 21:22:49.848653 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 21:22:49.848653 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 21:22:49.848653 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 21:22:49.848653 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:22:49.848653 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:22:49.848653 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:22:49.848653 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:22:49.848653 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:22:49.849689 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:22:49.849689 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:22:49.849689 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application with Lock( Jul 25 21:22:49.849689 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:22:49.849689 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:22:49.849689 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:22:49.849689 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:22:49.849689 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:22:49.849689 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:22:49.849689 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:22:49.849689 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:22:49.849689 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 21:22:49.849689 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 21:22:49.849689 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 21:22:49.849689 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Jul 25 21:22:49.849689 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 378/734] 10.222.0.66 () {56 vars in 1129 bytes} [Mon Jul 25 21:22:49 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 21:22:49.855463 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb528cf7-5e2d-4531-be7d-c25c166d547d None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:49.902891 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:49.989774 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb528cf7-5e2d-4531-be7d-c25c166d547d None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:50.024144 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a21a879-4a37-4466-8e21-be036cbe4647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:50.025135 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a21a879-4a37-4466-8e21-be036cbe4647 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:50.025629 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a21a879-4a37-4466-8e21-be036cbe4647 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:50.026090 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a21a879-4a37-4466-8e21-be036cbe4647 None admin] PATH_INFO: `/v3/services` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:50.026981 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a21a879-4a37-4466-8e21-be036cbe4647 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:50.027471 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a21a879-4a37-4466-8e21-be036cbe4647 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:50.029023 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a21a879-4a37-4466-8e21-be036cbe4647 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:50.034232 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 357/735] 10.222.0.66 () {56 vars in 1124 bytes} [Mon Jul 25 21:22:49 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:50.040013 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1ec0c1-775a-4715-8375-1f0b6a3f9a24 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:50.063323 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:50.145292 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1ec0c1-775a-4715-8375-1f0b6a3f9a24 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:50.185741 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb272d5-7ede-4544-8cec-70818bf666cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:50.186808 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb272d5-7ede-4544-8cec-70818bf666cd None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:50.187290 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb272d5-7ede-4544-8cec-70818bf666cd None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:50.187785 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb272d5-7ede-4544-8cec-70818bf666cd None admin] PATH_INFO: `/v3/services` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:50.189025 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb272d5-7ede-4544-8cec-70818bf666cd None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:50.189774 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb272d5-7ede-4544-8cec-70818bf666cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:50.192398 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb272d5-7ede-4544-8cec-70818bf666cd None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:50.200746 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 379/736] 10.222.0.66 () {56 vars in 1124 bytes} [Mon Jul 25 21:22:50 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:22:50.206631 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a21a879-4a37-4466-8e21-be036cbe4647 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:50.305031 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:50.309498 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a21a879-4a37-4466-8e21-be036cbe4647 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:50.332443 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cc6501-38aa-4b3b-81cb-74f76104dadd None None] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:50.333001 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cc6501-38aa-4b3b-81cb-74f76104dadd None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:50.333507 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cc6501-38aa-4b3b-81cb-74f76104dadd None None] PATH_INFO: `/` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:50.335290 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 380/737] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:22:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:22:50.342894 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22151502-56ea-413c-92a8-578c5d60004c None None] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:50.343583 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22151502-56ea-413c-92a8-578c5d60004c None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:50.344363 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22151502-56ea-413c-92a8-578c5d60004c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:50.351973 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c12052-dec6-4030-b8e0-3ac2d200bfcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:50.352612 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c12052-dec6-4030-b8e0-3ac2d200bfcf None admin] REQUEST_METHOD: `POST` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:50.352876 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c12052-dec6-4030-b8e0-3ac2d200bfcf None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:50.353175 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c12052-dec6-4030-b8e0-3ac2d200bfcf None admin] PATH_INFO: `/v3/endpoints` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:50.353884 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c12052-dec6-4030-b8e0-3ac2d200bfcf None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:50.355263 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c12052-dec6-4030-b8e0-3ac2d200bfcf None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:50.368346 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.auth.core [None req-22151502-56ea-413c-92a8-578c5d60004c None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:22:50.369808 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-22151502-56ea-413c-92a8-578c5d60004c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:22:50.379222 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 358/738] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Jul 25 21:22:50 2022] POST /identity/v3/endpoints => generated 346 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 21:22:50.464878 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 381/739] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:22:50 2022] POST /identity/v3/auth/tokens => generated 1247 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 21:22:50.486037 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c12052-dec6-4030-b8e0-3ac2d200bfcf None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:50.597713 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c12052-dec6-4030-b8e0-3ac2d200bfcf None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:50.632510 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6873102-c896-49ae-a081-07266dd71b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:50.633200 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6873102-c896-49ae-a081-07266dd71b81 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:50.633484 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6873102-c896-49ae-a081-07266dd71b81 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:50.633757 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6873102-c896-49ae-a081-07266dd71b81 None admin] PATH_INFO: `/v3/services/network` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:50.634392 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6873102-c896-49ae-a081-07266dd71b81 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:50.635788 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6873102-c896-49ae-a081-07266dd71b81 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:50.644919 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application [None req-d6873102-c896-49ae-a081-07266dd71b81 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 21:22:50.644919 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:22:50.644919 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 21:22:50.644919 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 21:22:50.644919 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 21:22:50.644919 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 21:22:50.644919 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 21:22:50.644919 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 21:22:50.644919 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 21:22:50.644919 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Jul 25 21:22:50.644919 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 21:22:50.644919 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Jul 25 21:22:50.644919 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:22:50.644919 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:22:50.644919 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:22:50.644919 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:22:50.644919 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:22:50.645962 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:22:50.645962 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:22:50.645962 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:22:50.645962 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:22:50.645962 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:22:50.645962 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:22:50.645962 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 21:22:50.645962 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 21:22:50.645962 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 21:22:50.645962 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 21:22:50.645962 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:22:50.645962 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:22:50.645962 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:22:50.645962 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:22:50.645962 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:22:50.645962 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:22:50.647466 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:22:50.647466 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application with Lock( Jul 25 21:22:50.647466 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:22:50.647466 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:22:50.647466 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:22:50.647466 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:22:50.647466 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:22:50.647466 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:22:50.647466 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:22:50.647466 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:22:50.647466 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 21:22:50.647466 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 21:22:50.647466 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 21:22:50.647466 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Jul 25 21:22:50.647466 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 359/740] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Jul 25 21:22:50 2022] GET /identity/v3/services/network => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:22:50.652044 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22151502-56ea-413c-92a8-578c5d60004c None None] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:50.664232 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:50.757193 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22151502-56ea-413c-92a8-578c5d60004c None None] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:50.793694 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c37b49-8064-4a0a-b781-7edee5ede3bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:50.794330 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c37b49-8064-4a0a-b781-7edee5ede3bc None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:50.794607 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c37b49-8064-4a0a-b781-7edee5ede3bc None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:50.794874 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c37b49-8064-4a0a-b781-7edee5ede3bc None admin] PATH_INFO: `/v3/services` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:50.795553 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c37b49-8064-4a0a-b781-7edee5ede3bc None admin] RBAC: Adding query filter params (name=network) {{(pid=87209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:50.795858 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c37b49-8064-4a0a-b781-7edee5ede3bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:50.797274 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c37b49-8064-4a0a-b781-7edee5ede3bc None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:50.802713 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 382/741] 10.222.0.66 () {56 vars in 1112 bytes} [Mon Jul 25 21:22:50 2022] GET /identity/v3/services?name=network => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:50.808578 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6873102-c896-49ae-a081-07266dd71b81 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:50.828853 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:50.911575 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6873102-c896-49ae-a081-07266dd71b81 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:50.957011 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfa9579-114d-4d16-a904-c1e4a281c4fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:50.957936 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfa9579-114d-4d16-a904-c1e4a281c4fc None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:50.958387 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfa9579-114d-4d16-a904-c1e4a281c4fc None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:50.958857 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfa9579-114d-4d16-a904-c1e4a281c4fc None admin] PATH_INFO: `/v3/services` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:50.959715 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfa9579-114d-4d16-a904-c1e4a281c4fc None admin] RBAC: Adding query filter params (type=network) {{(pid=87210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:50.960185 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfa9579-114d-4d16-a904-c1e4a281c4fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:50.961790 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfa9579-114d-4d16-a904-c1e4a281c4fc None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:50.972714 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 360/742] 10.222.0.66 () {56 vars in 1112 bytes} [Mon Jul 25 21:22:50 2022] GET /identity/v3/services?type=network => generated 350 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:50.978214 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c37b49-8064-4a0a-b781-7edee5ede3bc None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:51.056965 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:51.084600 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c37b49-8064-4a0a-b781-7edee5ede3bc None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:51.120036 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa18a7cc-8b1e-4199-b59c-587fec34673d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:51.121066 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa18a7cc-8b1e-4199-b59c-587fec34673d None admin] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:51.121579 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa18a7cc-8b1e-4199-b59c-587fec34673d None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:51.122067 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa18a7cc-8b1e-4199-b59c-587fec34673d None admin] PATH_INFO: `/v3/endpoints` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:51.123061 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa18a7cc-8b1e-4199-b59c-587fec34673d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:51.124740 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa18a7cc-8b1e-4199-b59c-587fec34673d None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:51.150221 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 383/743] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Jul 25 21:22:50 2022] POST /identity/v3/endpoints => generated 327 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 21:22:51.476601 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189b647b-7aef-4023-b18e-c120894566aa None None] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:51.477250 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189b647b-7aef-4023-b18e-c120894566aa None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:51.477250 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189b647b-7aef-4023-b18e-c120894566aa None None] PATH_INFO: `/` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:51.478752 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 361/744] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:22:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:22:51.484252 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7193cf91-143c-4b18-b437-27ef879e8d2d None None] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:51.484619 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7193cf91-143c-4b18-b437-27ef879e8d2d None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:51.484993 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7193cf91-143c-4b18-b437-27ef879e8d2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:51.505926 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.auth.core [None req-7193cf91-143c-4b18-b437-27ef879e8d2d None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:22:51.507325 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-7193cf91-143c-4b18-b437-27ef879e8d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:22:51.587917 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 384/745] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:22:51 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 21:22:51.611465 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189b647b-7aef-4023-b18e-c120894566aa None None] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:51.699577 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:51.719645 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189b647b-7aef-4023-b18e-c120894566aa None None] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:51.753293 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e74c38a-7589-436d-a3c5-c0d891c62f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:51.753832 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e74c38a-7589-436d-a3c5-c0d891c62f4f None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:51.754105 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e74c38a-7589-436d-a3c5-c0d891c62f4f None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:51.754372 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e74c38a-7589-436d-a3c5-c0d891c62f4f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:51.824311 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e74c38a-7589-436d-a3c5-c0d891c62f4f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:51.825808 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e74c38a-7589-436d-a3c5-c0d891c62f4f None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:51.907781 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:51.931439 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 362/746] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Jul 25 21:22:51 2022] GET /identity/v3/auth/tokens => generated 1396 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 21:22:51.934729 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7193cf91-143c-4b18-b437-27ef879e8d2d None None] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:52.003878 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:52.050988 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7193cf91-143c-4b18-b437-27ef879e8d2d None None] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:52.085791 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7889da2b-ab2a-494e-b567-8d40b75ef666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:52.086444 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7889da2b-ab2a-494e-b567-8d40b75ef666 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:52.086716 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7889da2b-ab2a-494e-b567-8d40b75ef666 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:52.086983 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7889da2b-ab2a-494e-b567-8d40b75ef666 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:52.097719 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7889da2b-ab2a-494e-b567-8d40b75ef666 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:52.099226 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7889da2b-ab2a-494e-b567-8d40b75ef666 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:52.116058 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application [None req-7889da2b-ab2a-494e-b567-8d40b75ef666 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:22:52.116058 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:22:52.116058 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:22:52.116058 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:22:52.116058 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:22:52.116058 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:22:52.116058 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:22:52.116058 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:22:52.116058 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:22:52.116058 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:22:52.116058 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:22:52.116058 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:22:52.116058 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:22:52.116058 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:22:52.116058 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:22:52.117024 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:22:52.117024 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:22:52.117024 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:22:52.117024 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:22:52.117024 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:22:52.117024 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:22:52.117024 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:22:52.117024 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:22:52.117024 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application with Lock( Jul 25 21:22:52.117024 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:22:52.117024 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:22:52.117024 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:22:52.117024 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:22:52.117024 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:22:52.117024 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:22:52.117024 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:22:52.117024 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:22:52.123191 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:22:52.123191 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:22:52.123191 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:22:52.123191 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Jul 25 21:22:52.123191 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 385/747] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 25 21:22:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:22:52.125136 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e74c38a-7589-436d-a3c5-c0d891c62f4f None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:52.235715 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e74c38a-7589-436d-a3c5-c0d891c62f4f None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:52.267185 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a6a28-fd88-404f-a9c3-7bfa6901ea13 None None] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:52.267185 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a6a28-fd88-404f-a9c3-7bfa6901ea13 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:52.267185 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a6a28-fd88-404f-a9c3-7bfa6901ea13 None None] PATH_INFO: `/` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:52.267185 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 386/748] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:22:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:22:52.271505 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20599ad7-d790-4018-8c25-9f3254344402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:52.272330 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20599ad7-d790-4018-8c25-9f3254344402 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:52.272611 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20599ad7-d790-4018-8c25-9f3254344402 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:52.272715 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b67464a-b803-4458-9165-c699495c0cf9 None None] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:52.272883 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20599ad7-d790-4018-8c25-9f3254344402 None admin] PATH_INFO: `/v3/domains` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:52.272977 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b67464a-b803-4458-9165-c699495c0cf9 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:52.273231 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b67464a-b803-4458-9165-c699495c0cf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:52.273609 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20599ad7-d790-4018-8c25-9f3254344402 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:52.273911 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20599ad7-d790-4018-8c25-9f3254344402 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:52.275279 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20599ad7-d790-4018-8c25-9f3254344402 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:52.294950 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 363/749] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Jul 25 21:22:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:22:52.295157 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.auth.core [None req-3b67464a-b803-4458-9165-c699495c0cf9 None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:22:52.295157 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-3b67464a-b803-4458-9165-c699495c0cf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:22:52.372570 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 387/750] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:22:52 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 21:22:52.396322 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20599ad7-d790-4018-8c25-9f3254344402 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:52.444486 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:52.507511 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20599ad7-d790-4018-8c25-9f3254344402 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:52.546059 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ab2119-be73-4b0c-b9a8-d3adc91384ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:52.546772 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ab2119-be73-4b0c-b9a8-d3adc91384ed None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:52.547049 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ab2119-be73-4b0c-b9a8-d3adc91384ed None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:52.547323 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ab2119-be73-4b0c-b9a8-d3adc91384ed None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:52.547958 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ab2119-be73-4b0c-b9a8-d3adc91384ed None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:52.549836 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ab2119-be73-4b0c-b9a8-d3adc91384ed None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:52.559221 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application [None req-b5ab2119-be73-4b0c-b9a8-d3adc91384ed None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 21:22:52.559221 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:22:52.559221 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 21:22:52.559221 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 21:22:52.559221 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 21:22:52.559221 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 21:22:52.559221 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 21:22:52.559221 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 21:22:52.559221 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 21:22:52.559221 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Jul 25 21:22:52.559221 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 21:22:52.559221 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Jul 25 21:22:52.559221 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:22:52.559221 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:22:52.559221 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:22:52.559221 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:22:52.560250 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:22:52.560250 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:22:52.560250 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:22:52.560250 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:22:52.560250 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:22:52.560250 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:22:52.560250 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:22:52.560250 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 21:22:52.560250 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 21:22:52.560250 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 21:22:52.560250 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 21:22:52.560250 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:22:52.560250 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:22:52.560250 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:22:52.560250 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:22:52.560250 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:22:52.561485 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:22:52.561485 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:22:52.561485 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application with Lock( Jul 25 21:22:52.561485 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:22:52.561485 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:22:52.561485 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:22:52.561485 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:22:52.561485 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:22:52.561485 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:22:52.561485 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:22:52.561485 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:22:52.561485 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 21:22:52.561485 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 21:22:52.561485 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 21:22:52.561485 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Jul 25 21:22:52.561485 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 364/751] 10.222.0.66 () {56 vars in 1132 bytes} [Mon Jul 25 21:22:52 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:22:52.567051 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b67464a-b803-4458-9165-c699495c0cf9 None None] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:52.608969 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:52.673268 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b67464a-b803-4458-9165-c699495c0cf9 None None] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:52.708539 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9b1f54-579a-42f2-b090-7fdb315f5198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:52.709193 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9b1f54-579a-42f2-b090-7fdb315f5198 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:52.709467 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9b1f54-579a-42f2-b090-7fdb315f5198 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:52.709732 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9b1f54-579a-42f2-b090-7fdb315f5198 None admin] PATH_INFO: `/v3/services` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:52.710393 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9b1f54-579a-42f2-b090-7fdb315f5198 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:52.710686 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9b1f54-579a-42f2-b090-7fdb315f5198 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:52.712142 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9b1f54-579a-42f2-b090-7fdb315f5198 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:52.716751 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 388/752] 10.222.0.66 () {56 vars in 1126 bytes} [Mon Jul 25 21:22:52 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:52.722830 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ab2119-be73-4b0c-b9a8-d3adc91384ed None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:52.792677 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad926477-7031-462f-bcf4-07c808b8f711 None None] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:52.792976 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad926477-7031-462f-bcf4-07c808b8f711 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:52.793281 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad926477-7031-462f-bcf4-07c808b8f711 None None] PATH_INFO: `/` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:52.794659 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 389/753] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:22:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:22:52.800867 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719bb4bb-b2fd-4d69-ba34-c2942bee2d7e None None] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:52.801025 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719bb4bb-b2fd-4d69-ba34-c2942bee2d7e None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:52.801313 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719bb4bb-b2fd-4d69-ba34-c2942bee2d7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:52.823467 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.auth.core [None req-719bb4bb-b2fd-4d69-ba34-c2942bee2d7e None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:22:52.824704 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-719bb4bb-b2fd-4d69-ba34-c2942bee2d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:22:52.832350 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ab2119-be73-4b0c-b9a8-d3adc91384ed None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:52.840170 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:52.868235 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2834cf82-0403-4e2b-b149-441928bdc7ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:52.868884 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2834cf82-0403-4e2b-b149-441928bdc7ca None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:52.869360 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2834cf82-0403-4e2b-b149-441928bdc7ca None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:52.869474 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2834cf82-0403-4e2b-b149-441928bdc7ca None admin] PATH_INFO: `/v3/services` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:52.870133 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2834cf82-0403-4e2b-b149-441928bdc7ca None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:52.870434 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2834cf82-0403-4e2b-b149-441928bdc7ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:52.871818 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2834cf82-0403-4e2b-b149-441928bdc7ca None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:52.876971 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 365/754] 10.222.0.66 () {56 vars in 1126 bytes} [Mon Jul 25 21:22:52 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:52.900319 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 390/755] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:22:52 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 21:22:52.924762 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2834cf82-0403-4e2b-b149-441928bdc7ca None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:53.043755 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2834cf82-0403-4e2b-b149-441928bdc7ca None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:53.081392 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9722b527-56e8-4b42-815a-e1f52c1a6532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:53.081972 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9722b527-56e8-4b42-815a-e1f52c1a6532 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:53.082246 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9722b527-56e8-4b42-815a-e1f52c1a6532 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:53.082525 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9722b527-56e8-4b42-815a-e1f52c1a6532 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:53.083162 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9722b527-56e8-4b42-815a-e1f52c1a6532 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:53.084558 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9722b527-56e8-4b42-815a-e1f52c1a6532 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:53.093402 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application [None req-9722b527-56e8-4b42-815a-e1f52c1a6532 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 21:22:53.093402 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:22:53.093402 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 21:22:53.093402 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 21:22:53.093402 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 21:22:53.093402 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 21:22:53.093402 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 21:22:53.093402 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 21:22:53.093402 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 21:22:53.093402 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Jul 25 21:22:53.093402 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 21:22:53.093402 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Jul 25 21:22:53.093402 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:22:53.093402 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:22:53.093402 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:22:53.093402 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:22:53.093402 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:22:53.094519 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:22:53.094519 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:22:53.094519 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:22:53.094519 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:22:53.094519 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:22:53.094519 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:22:53.094519 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 21:22:53.094519 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 21:22:53.094519 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 21:22:53.094519 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 21:22:53.094519 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:22:53.094519 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:22:53.094519 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:22:53.094519 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:22:53.094519 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:22:53.094519 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:22:53.095365 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:22:53.095365 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application with Lock( Jul 25 21:22:53.095365 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:22:53.095365 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:22:53.095365 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:22:53.095365 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:22:53.095365 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:22:53.095365 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:22:53.095365 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:22:53.095365 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:22:53.095365 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 21:22:53.095365 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 21:22:53.095365 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 21:22:53.095365 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Jul 25 21:22:53.095365 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 366/756] 10.222.0.66 () {56 vars in 1114 bytes} [Mon Jul 25 21:22:52 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:22:53.100664 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719bb4bb-b2fd-4d69-ba34-c2942bee2d7e None None] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:53.132126 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:53.203948 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719bb4bb-b2fd-4d69-ba34-c2942bee2d7e None None] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:53.240273 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cb51e4-5b7f-45c3-8968-c2e961264414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:53.240901 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cb51e4-5b7f-45c3-8968-c2e961264414 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:53.241209 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cb51e4-5b7f-45c3-8968-c2e961264414 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:53.241480 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cb51e4-5b7f-45c3-8968-c2e961264414 None admin] PATH_INFO: `/v3/services` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:53.242154 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cb51e4-5b7f-45c3-8968-c2e961264414 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:53.242454 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cb51e4-5b7f-45c3-8968-c2e961264414 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:53.243832 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cb51e4-5b7f-45c3-8968-c2e961264414 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:53.248557 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 391/757] 10.222.0.66 () {56 vars in 1114 bytes} [Mon Jul 25 21:22:53 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:53.254589 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9722b527-56e8-4b42-815a-e1f52c1a6532 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:53.291080 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:53.356394 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9722b527-56e8-4b42-815a-e1f52c1a6532 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:53.390732 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2364bde8-f981-43c5-bab8-56f7f5b59231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:53.391389 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2364bde8-f981-43c5-bab8-56f7f5b59231 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:53.391650 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2364bde8-f981-43c5-bab8-56f7f5b59231 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:53.391917 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2364bde8-f981-43c5-bab8-56f7f5b59231 None admin] PATH_INFO: `/v3/services` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:53.392807 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2364bde8-f981-43c5-bab8-56f7f5b59231 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:53.393127 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2364bde8-f981-43c5-bab8-56f7f5b59231 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:53.394522 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2364bde8-f981-43c5-bab8-56f7f5b59231 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:53.399180 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 367/758] 10.222.0.66 () {56 vars in 1114 bytes} [Mon Jul 25 21:22:53 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:55.094552 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6c7d51-d486-4576-a52e-ca783d3f0aa1 None None] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:55.095077 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6c7d51-d486-4576-a52e-ca783d3f0aa1 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:55.095196 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6c7d51-d486-4576-a52e-ca783d3f0aa1 None None] PATH_INFO: `/` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:55.096860 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 392/759] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:22:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:22:55.102287 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3cd957-ebfc-4a11-a2af-77b7fccd238b None None] REQUEST_METHOD: `POST` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:55.102730 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3cd957-ebfc-4a11-a2af-77b7fccd238b None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:55.102817 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3cd957-ebfc-4a11-a2af-77b7fccd238b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:55.121666 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.auth.core [None req-fb3cd957-ebfc-4a11-a2af-77b7fccd238b None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:22:55.122847 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.fernet_utils [None req-fb3cd957-ebfc-4a11-a2af-77b7fccd238b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:22:55.192211 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 368/760] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:22:55 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 21:22:55.216778 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6c7d51-d486-4576-a52e-ca783d3f0aa1 None None] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:55.315114 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:55.322368 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6c7d51-d486-4576-a52e-ca783d3f0aa1 None None] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:55.356386 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b4762e-90be-4a83-970b-62994f109bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:55.357036 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b4762e-90be-4a83-970b-62994f109bd3 None admin] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:55.357337 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b4762e-90be-4a83-970b-62994f109bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:55.357606 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b4762e-90be-4a83-970b-62994f109bd3 None admin] PATH_INFO: `/v3/services` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:55.358302 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b4762e-90be-4a83-970b-62994f109bd3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:55.359670 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b4762e-90be-4a83-970b-62994f109bd3 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:55.376129 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 393/761] 10.222.0.66 () {60 vars in 1141 bytes} [Mon Jul 25 21:22:55 2022] POST /identity/v3/services => generated 269 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 21:22:55.645975 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beaab08-0be3-4b3b-ba40-262e442697ae None None] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:55.646208 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beaab08-0be3-4b3b-ba40-262e442697ae None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:55.646509 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beaab08-0be3-4b3b-ba40-262e442697ae None None] PATH_INFO: `/` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:55.647856 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 369/762] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:22:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:22:55.653312 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e7ed2a-6939-4d97-903e-0de0057575b8 None None] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:55.653604 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e7ed2a-6939-4d97-903e-0de0057575b8 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:55.653883 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e7ed2a-6939-4d97-903e-0de0057575b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:55.672743 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.auth.core [None req-33e7ed2a-6939-4d97-903e-0de0057575b8 None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:22:55.673989 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-33e7ed2a-6939-4d97-903e-0de0057575b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:22:55.749584 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 394/763] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:22:55 2022] POST /identity/v3/auth/tokens => generated 1506 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 21:22:55.773551 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beaab08-0be3-4b3b-ba40-262e442697ae None None] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:55.807843 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:55.891741 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beaab08-0be3-4b3b-ba40-262e442697ae None None] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:55.929539 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041a9990-db76-4c73-8531-acc7d19a5ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:55.930067 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041a9990-db76-4c73-8531-acc7d19a5ec4 None admin] REQUEST_METHOD: `POST` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:55.930344 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041a9990-db76-4c73-8531-acc7d19a5ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:55.930617 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041a9990-db76-4c73-8531-acc7d19a5ec4 None admin] PATH_INFO: `/v3/services` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:55.931343 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041a9990-db76-4c73-8531-acc7d19a5ec4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:55.932733 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041a9990-db76-4c73-8531-acc7d19a5ec4 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:55.952580 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 370/764] 10.222.0.66 () {60 vars in 1141 bytes} [Mon Jul 25 21:22:55 2022] POST /identity/v3/services => generated 251 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 21:22:57.621123 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893b649a-27a1-42a8-99b9-5cd83687ad6e None None] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:57.621685 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893b649a-27a1-42a8-99b9-5cd83687ad6e None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:57.621685 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893b649a-27a1-42a8-99b9-5cd83687ad6e None None] PATH_INFO: `/` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:57.623210 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 395/765] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:22:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:22:57.628752 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669f2c2c-5b5a-45b7-a947-38024e5ff4bf None None] REQUEST_METHOD: `POST` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:57.629210 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669f2c2c-5b5a-45b7-a947-38024e5ff4bf None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:57.629335 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669f2c2c-5b5a-45b7-a947-38024e5ff4bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:57.649246 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.auth.core [None req-669f2c2c-5b5a-45b7-a947-38024e5ff4bf None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:22:57.650499 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.fernet_utils [None req-669f2c2c-5b5a-45b7-a947-38024e5ff4bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:22:57.730516 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 371/766] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:22:57 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 21:22:57.755199 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893b649a-27a1-42a8-99b9-5cd83687ad6e None None] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:57.842976 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:57.864736 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893b649a-27a1-42a8-99b9-5cd83687ad6e None None] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:57.901364 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b69b614-8040-49c2-8931-c7b35e03fd11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:57.901928 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b69b614-8040-49c2-8931-c7b35e03fd11 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:57.902202 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b69b614-8040-49c2-8931-c7b35e03fd11 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:57.902469 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b69b614-8040-49c2-8931-c7b35e03fd11 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:57.903097 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b69b614-8040-49c2-8931-c7b35e03fd11 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:57.904478 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b69b614-8040-49c2-8931-c7b35e03fd11 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:57.913794 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application [None req-7b69b614-8040-49c2-8931-c7b35e03fd11 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 21:22:57.913794 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:22:57.913794 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 21:22:57.913794 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 21:22:57.913794 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 21:22:57.913794 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 21:22:57.913794 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 21:22:57.913794 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 21:22:57.913794 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 21:22:57.913794 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Jul 25 21:22:57.913794 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 21:22:57.913794 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Jul 25 21:22:57.913794 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:22:57.913794 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:22:57.913794 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:22:57.913794 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:22:57.915077 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:22:57.915077 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:22:57.915077 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:22:57.915077 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:22:57.915077 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:22:57.915077 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:22:57.915077 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:22:57.915077 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 21:22:57.915077 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 21:22:57.915077 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 21:22:57.915077 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 21:22:57.915077 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:22:57.915077 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:22:57.915077 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:22:57.915077 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:22:57.915077 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:22:57.915924 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:22:57.915924 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:22:57.915924 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application with Lock( Jul 25 21:22:57.915924 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:22:57.915924 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:22:57.915924 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:22:57.915924 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:22:57.915924 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:22:57.915924 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:22:57.915924 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:22:57.915924 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:22:57.915924 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 21:22:57.915924 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 21:22:57.915924 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 21:22:57.915924 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Jul 25 21:22:57.915924 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 396/767] 10.222.0.66 () {56 vars in 1132 bytes} [Mon Jul 25 21:22:57 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:22:57.921441 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669f2c2c-5b5a-45b7-a947-38024e5ff4bf None None] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:57.937282 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:58.036615 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669f2c2c-5b5a-45b7-a947-38024e5ff4bf None None] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:58.074797 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dff97d5-0676-47ee-b77d-342d41fb4aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:58.075418 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dff97d5-0676-47ee-b77d-342d41fb4aed None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:58.075695 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dff97d5-0676-47ee-b77d-342d41fb4aed None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:58.075963 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dff97d5-0676-47ee-b77d-342d41fb4aed None admin] PATH_INFO: `/v3/services` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:58.076639 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dff97d5-0676-47ee-b77d-342d41fb4aed None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:58.076939 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dff97d5-0676-47ee-b77d-342d41fb4aed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:58.078371 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dff97d5-0676-47ee-b77d-342d41fb4aed None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:58.083200 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 372/768] 10.222.0.66 () {56 vars in 1126 bytes} [Mon Jul 25 21:22:57 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:58.089170 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b69b614-8040-49c2-8931-c7b35e03fd11 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:58.184297 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899a5b6c-2db3-4b09-8385-f803038daf44 None None] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:58.184504 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899a5b6c-2db3-4b09-8385-f803038daf44 None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:58.184753 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899a5b6c-2db3-4b09-8385-f803038daf44 None None] PATH_INFO: `/` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:58.186396 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 373/769] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:22:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 21:22:58.191622 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e00c22-1cec-4139-94cc-f3369525f9d0 None None] REQUEST_METHOD: `POST` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:58.191769 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b69b614-8040-49c2-8931-c7b35e03fd11 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:58.191895 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e00c22-1cec-4139-94cc-f3369525f9d0 None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:58.192180 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e00c22-1cec-4139-94cc-f3369525f9d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:58.210203 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.auth.core [None req-b4e00c22-1cec-4139-94cc-f3369525f9d0 None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:22:58.211373 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.fernet_utils [None req-b4e00c22-1cec-4139-94cc-f3369525f9d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:22:58.226540 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70ad8b6-f32d-479f-a129-a2412d635aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:58.227153 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70ad8b6-f32d-479f-a129-a2412d635aad None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:58.227431 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70ad8b6-f32d-479f-a129-a2412d635aad None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:58.227699 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70ad8b6-f32d-479f-a129-a2412d635aad None admin] PATH_INFO: `/v3/services` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:58.228370 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70ad8b6-f32d-479f-a129-a2412d635aad None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:58.228672 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70ad8b6-f32d-479f-a129-a2412d635aad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:58.230091 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70ad8b6-f32d-479f-a129-a2412d635aad None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:58.234916 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 397/770] 10.222.0.66 () {56 vars in 1126 bytes} [Mon Jul 25 21:22:58 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:58.241142 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70ad8b6-f32d-479f-a129-a2412d635aad None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:58.253346 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:58.284960 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 374/771] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:22:58 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 21:22:58.312068 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e00c22-1cec-4139-94cc-f3369525f9d0 None None] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:58.322290 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:58.347012 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70ad8b6-f32d-479f-a129-a2412d635aad None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:58.381568 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7863d8-82e5-4e1b-af3c-94e661ef4746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:58.382226 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7863d8-82e5-4e1b-af3c-94e661ef4746 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:58.382515 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7863d8-82e5-4e1b-af3c-94e661ef4746 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:58.382787 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7863d8-82e5-4e1b-af3c-94e661ef4746 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:58.383541 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7863d8-82e5-4e1b-af3c-94e661ef4746 None admin] RBAC: Adding query filter params (interface=public, service_id=516853d130dd4bf4904c8b7a1f62aadf, region_id=RegionOne) {{(pid=87209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:58.383857 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7863d8-82e5-4e1b-af3c-94e661ef4746 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:58.385247 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7863d8-82e5-4e1b-af3c-94e661ef4746 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:58.390322 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 398/772] 10.222.0.66 () {56 vars in 1251 bytes} [Mon Jul 25 21:22:58 2022] GET /identity/v3/endpoints?service_id=516853d130dd4bf4904c8b7a1f62aadf&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:58.396169 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7863d8-82e5-4e1b-af3c-94e661ef4746 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:58.410453 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e00c22-1cec-4139-94cc-f3369525f9d0 None None] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:58.443962 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02505e47-8348-43f7-8223-b6d175fca157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:58.444528 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02505e47-8348-43f7-8223-b6d175fca157 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:58.444799 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02505e47-8348-43f7-8223-b6d175fca157 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:58.445066 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02505e47-8348-43f7-8223-b6d175fca157 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:58.445724 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02505e47-8348-43f7-8223-b6d175fca157 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:58.447103 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02505e47-8348-43f7-8223-b6d175fca157 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:58.456486 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application [None req-02505e47-8348-43f7-8223-b6d175fca157 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 21:22:58.456486 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:22:58.456486 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 21:22:58.456486 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 21:22:58.456486 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 21:22:58.456486 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 21:22:58.456486 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 21:22:58.456486 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 21:22:58.456486 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 21:22:58.456486 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Jul 25 21:22:58.456486 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 21:22:58.456486 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Jul 25 21:22:58.456486 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:22:58.456486 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:22:58.456486 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:22:58.456486 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:22:58.456486 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:22:58.457653 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:22:58.457653 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:22:58.457653 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:22:58.457653 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:22:58.457653 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:22:58.457653 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:22:58.457653 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 21:22:58.457653 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 21:22:58.457653 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 21:22:58.457653 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 21:22:58.457653 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:22:58.457653 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:22:58.457653 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:22:58.457653 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:22:58.457653 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:22:58.457653 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:22:58.458901 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:22:58.458901 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application with Lock( Jul 25 21:22:58.458901 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:22:58.458901 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:22:58.458901 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:22:58.458901 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:22:58.458901 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:22:58.458901 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:22:58.458901 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:22:58.458901 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:22:58.458901 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 21:22:58.458901 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 21:22:58.458901 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 21:22:58.458901 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Jul 25 21:22:58.458901 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 375/773] 10.222.0.66 () {56 vars in 1114 bytes} [Mon Jul 25 21:22:58 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:22:58.463928 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02505e47-8348-43f7-8223-b6d175fca157 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:58.477589 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:58.503252 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7863d8-82e5-4e1b-af3c-94e661ef4746 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:58.535010 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:58.537291 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2f0b18-5741-4ce5-8f57-4e27fb948802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:58.537967 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2f0b18-5741-4ce5-8f57-4e27fb948802 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:58.538241 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2f0b18-5741-4ce5-8f57-4e27fb948802 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:58.538504 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2f0b18-5741-4ce5-8f57-4e27fb948802 None admin] PATH_INFO: `/v3/services` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:58.539137 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2f0b18-5741-4ce5-8f57-4e27fb948802 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:58.540848 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2f0b18-5741-4ce5-8f57-4e27fb948802 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:58.546757 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 399/774] 10.222.0.66 () {56 vars in 1087 bytes} [Mon Jul 25 21:22:58 2022] GET /identity/v3/services => generated 1498 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 21:22:58.568639 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02505e47-8348-43f7-8223-b6d175fca157 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:58.609634 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acaf928-1076-4471-a0f7-697f6e7f3ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:58.610347 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acaf928-1076-4471-a0f7-697f6e7f3ecb None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:58.610573 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acaf928-1076-4471-a0f7-697f6e7f3ecb None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:58.610843 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acaf928-1076-4471-a0f7-697f6e7f3ecb None admin] PATH_INFO: `/v3/services` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:58.611759 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acaf928-1076-4471-a0f7-697f6e7f3ecb None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:58.612228 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acaf928-1076-4471-a0f7-697f6e7f3ecb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:58.613593 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acaf928-1076-4471-a0f7-697f6e7f3ecb None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:58.619613 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 376/775] 10.222.0.66 () {56 vars in 1114 bytes} [Mon Jul 25 21:22:58 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:22:58.626089 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2f0b18-5741-4ce5-8f57-4e27fb948802 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:58.737553 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2f0b18-5741-4ce5-8f57-4e27fb948802 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:58.772203 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be84a65-a056-4423-bd21-30e9053fd75f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:58.772849 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be84a65-a056-4423-bd21-30e9053fd75f None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:58.773143 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be84a65-a056-4423-bd21-30e9053fd75f None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:58.773433 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be84a65-a056-4423-bd21-30e9053fd75f None admin] PATH_INFO: `/v3/services` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:58.774117 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be84a65-a056-4423-bd21-30e9053fd75f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:58.774417 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be84a65-a056-4423-bd21-30e9053fd75f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:58.775821 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be84a65-a056-4423-bd21-30e9053fd75f None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:58.780824 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 400/776] 10.222.0.66 () {56 vars in 1114 bytes} [Mon Jul 25 21:22:58 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:58.787058 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acaf928-1076-4471-a0f7-697f6e7f3ecb None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:58.890740 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acaf928-1076-4471-a0f7-697f6e7f3ecb None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:58.926152 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d393ba-b099-4925-b810-787f8813753a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:58.926779 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d393ba-b099-4925-b810-787f8813753a None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:58.927056 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d393ba-b099-4925-b810-787f8813753a None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:58.927329 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d393ba-b099-4925-b810-787f8813753a None admin] PATH_INFO: `/v3/endpoints` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:58.928087 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d393ba-b099-4925-b810-787f8813753a None admin] RBAC: Adding query filter params (interface=public, service_id=d2417429d91d44a9af36cd2aa9ebb080, region_id=RegionOne) {{(pid=87210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:22:58.928398 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d393ba-b099-4925-b810-787f8813753a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:58.929806 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d393ba-b099-4925-b810-787f8813753a None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:58.932274 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:58.940891 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 377/777] 10.222.0.66 () {56 vars in 1251 bytes} [Mon Jul 25 21:22:58 2022] GET /identity/v3/endpoints?service_id=d2417429d91d44a9af36cd2aa9ebb080&interface=public®ion_id=RegionOne => generated 194 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:22:58.942192 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be84a65-a056-4423-bd21-30e9053fd75f None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:22:58.945510 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:59.054487 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be84a65-a056-4423-bd21-30e9053fd75f None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:22:59.089385 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b31ddb-b0e1-47ce-affe-96d6ef1eafcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:22:59.090013 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b31ddb-b0e1-47ce-affe-96d6ef1eafcb None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:22:59.090288 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b31ddb-b0e1-47ce-affe-96d6ef1eafcb None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:22:59.090554 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b31ddb-b0e1-47ce-affe-96d6ef1eafcb None admin] PATH_INFO: `/v3/services` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:22:59.091193 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b31ddb-b0e1-47ce-affe-96d6ef1eafcb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:22:59.092565 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b31ddb-b0e1-47ce-affe-96d6ef1eafcb None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:22:59.098722 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 401/778] 10.222.0.66 () {56 vars in 1087 bytes} [Mon Jul 25 21:22:58 2022] GET /identity/v3/services => generated 1498 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 21:23:00.794937 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18db0711-bcfb-4f48-afdc-6f8f1ad6142b None None] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:23:00.795542 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18db0711-bcfb-4f48-afdc-6f8f1ad6142b None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:23:00.795542 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18db0711-bcfb-4f48-afdc-6f8f1ad6142b None None] PATH_INFO: `/` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:23:00.796849 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 378/779] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:23:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:23:00.802478 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0961cc3f-c361-41da-a7f0-29676e3b7d94 None None] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:23:00.802950 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0961cc3f-c361-41da-a7f0-29676e3b7d94 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:23:00.803048 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0961cc3f-c361-41da-a7f0-29676e3b7d94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:23:00.822376 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.auth.core [None req-0961cc3f-c361-41da-a7f0-29676e3b7d94 None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:23:00.823559 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-0961cc3f-c361-41da-a7f0-29676e3b7d94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:23:00.889352 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:23:00.898135 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 402/780] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:23:00 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 21:23:00.922462 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18db0711-bcfb-4f48-afdc-6f8f1ad6142b None None] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:23:01.029976 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18db0711-bcfb-4f48-afdc-6f8f1ad6142b None None] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:23:01.066753 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba5cf99-d65c-416a-9869-43375bc8994b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:23:01.067311 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba5cf99-d65c-416a-9869-43375bc8994b None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:23:01.067582 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba5cf99-d65c-416a-9869-43375bc8994b None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:23:01.067854 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba5cf99-d65c-416a-9869-43375bc8994b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:23:01.068483 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba5cf99-d65c-416a-9869-43375bc8994b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:23:01.069887 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba5cf99-d65c-416a-9869-43375bc8994b None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:23:01.078889 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application [None req-dba5cf99-d65c-416a-9869-43375bc8994b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 21:23:01.078889 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:23:01.078889 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 21:23:01.078889 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 21:23:01.078889 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 21:23:01.078889 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 21:23:01.078889 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 21:23:01.078889 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 21:23:01.078889 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 21:23:01.078889 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Jul 25 21:23:01.078889 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 21:23:01.078889 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Jul 25 21:23:01.078889 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:23:01.078889 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:23:01.078889 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:23:01.078889 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:23:01.080169 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:23:01.080169 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:23:01.080169 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:23:01.080169 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:23:01.080169 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:23:01.080169 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:23:01.080169 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:23:01.080169 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 21:23:01.080169 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 21:23:01.080169 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 21:23:01.080169 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 21:23:01.080169 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:23:01.080169 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:23:01.080169 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:23:01.080169 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:23:01.080169 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:23:01.081587 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:23:01.081587 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:23:01.081587 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application with Lock( Jul 25 21:23:01.081587 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:23:01.081587 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:23:01.081587 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:23:01.081587 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:23:01.081587 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:23:01.081587 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:23:01.081587 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:23:01.081587 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:23:01.081587 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 21:23:01.081587 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 21:23:01.081587 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 21:23:01.081587 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Jul 25 21:23:01.081587 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 379/781] 10.222.0.66 () {56 vars in 1132 bytes} [Mon Jul 25 21:23:00 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:23:01.086446 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0961cc3f-c361-41da-a7f0-29676e3b7d94 None None] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:23:01.195154 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0961cc3f-c361-41da-a7f0-29676e3b7d94 None None] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:23:01.231061 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d95aaf3-1589-4ce9-b42b-28363d92d337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:23:01.232111 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d95aaf3-1589-4ce9-b42b-28363d92d337 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:23:01.234719 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d95aaf3-1589-4ce9-b42b-28363d92d337 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:23:01.235003 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d95aaf3-1589-4ce9-b42b-28363d92d337 None admin] PATH_INFO: `/v3/services` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:23:01.235787 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d95aaf3-1589-4ce9-b42b-28363d92d337 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:23:01.236233 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d95aaf3-1589-4ce9-b42b-28363d92d337 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:23:01.237763 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d95aaf3-1589-4ce9-b42b-28363d92d337 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:23:01.244106 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 403/782] 10.222.0.66 () {56 vars in 1126 bytes} [Mon Jul 25 21:23:01 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:23:01.250148 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba5cf99-d65c-416a-9869-43375bc8994b None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:23:01.308276 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5467e7e3-78aa-4508-8af4-bdde1c34adec None None] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:23:01.308552 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5467e7e3-78aa-4508-8af4-bdde1c34adec None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:23:01.308826 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5467e7e3-78aa-4508-8af4-bdde1c34adec None None] PATH_INFO: `/` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:23:01.310240 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 404/783] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:23:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:23:01.315595 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f673748-df7e-44cb-ac46-544684e469b1 None None] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:23:01.315882 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f673748-df7e-44cb-ac46-544684e469b1 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:23:01.316154 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f673748-df7e-44cb-ac46-544684e469b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:23:01.318115 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:23:01.335860 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.auth.core [None req-0f673748-df7e-44cb-ac46-544684e469b1 None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:23:01.337068 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-0f673748-df7e-44cb-ac46-544684e469b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:23:01.357406 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba5cf99-d65c-416a-9869-43375bc8994b None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:23:01.392061 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24040f0-0393-476c-9285-42e84a808868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:23:01.392869 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24040f0-0393-476c-9285-42e84a808868 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:23:01.393171 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24040f0-0393-476c-9285-42e84a808868 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:23:01.393464 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24040f0-0393-476c-9285-42e84a808868 None admin] PATH_INFO: `/v3/services` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:23:01.394144 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24040f0-0393-476c-9285-42e84a808868 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:23:01.394524 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24040f0-0393-476c-9285-42e84a808868 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:23:01.394680 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:23:01.396180 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24040f0-0393-476c-9285-42e84a808868 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:23:01.401460 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 380/784] 10.222.0.66 () {56 vars in 1126 bytes} [Mon Jul 25 21:23:01 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:23:01.407318 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24040f0-0393-476c-9285-42e84a808868 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:23:01.407722 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 405/785] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:23:01 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 21:23:01.431450 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f673748-df7e-44cb-ac46-544684e469b1 None None] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:23:01.511501 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24040f0-0393-476c-9285-42e84a808868 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:23:01.530402 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f673748-df7e-44cb-ac46-544684e469b1 None None] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:23:01.538609 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:23:01.547943 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e0fe3b-9995-406e-8455-18ebbf8e8892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:23:01.548578 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e0fe3b-9995-406e-8455-18ebbf8e8892 None admin] REQUEST_METHOD: `POST` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:23:01.548851 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e0fe3b-9995-406e-8455-18ebbf8e8892 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:23:01.549147 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e0fe3b-9995-406e-8455-18ebbf8e8892 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:23:01.549844 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e0fe3b-9995-406e-8455-18ebbf8e8892 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:23:01.551210 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e0fe3b-9995-406e-8455-18ebbf8e8892 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:23:01.566055 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a48d2ba-abbe-4370-a30f-36cfcb926680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:23:01.566828 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a48d2ba-abbe-4370-a30f-36cfcb926680 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:23:01.567159 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a48d2ba-abbe-4370-a30f-36cfcb926680 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:23:01.567491 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a48d2ba-abbe-4370-a30f-36cfcb926680 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:23:01.568184 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a48d2ba-abbe-4370-a30f-36cfcb926680 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:23:01.569540 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a48d2ba-abbe-4370-a30f-36cfcb926680 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:23:01.570741 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 381/786] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Jul 25 21:23:01 2022] POST /identity/v3/endpoints => generated 347 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 21:23:01.580981 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application [None req-7a48d2ba-abbe-4370-a30f-36cfcb926680 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 21:23:01.580981 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:23:01.580981 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 21:23:01.580981 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 21:23:01.580981 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 21:23:01.580981 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 21:23:01.580981 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 21:23:01.580981 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 21:23:01.580981 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 21:23:01.580981 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Jul 25 21:23:01.580981 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 21:23:01.580981 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Jul 25 21:23:01.580981 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:23:01.580981 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:23:01.580981 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:23:01.580981 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:23:01.580981 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:23:01.586287 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:23:01.586287 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:23:01.586287 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:23:01.586287 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:23:01.586287 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:23:01.586287 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:23:01.586287 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 21:23:01.586287 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 21:23:01.586287 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 21:23:01.586287 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 21:23:01.586287 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:23:01.586287 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:23:01.586287 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:23:01.586287 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:23:01.586287 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:23:01.586287 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:23:01.587248 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:23:01.587248 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application with Lock( Jul 25 21:23:01.587248 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:23:01.587248 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:23:01.587248 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:23:01.587248 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:23:01.587248 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:23:01.587248 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:23:01.587248 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:23:01.587248 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:23:01.587248 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 21:23:01.587248 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 21:23:01.587248 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 21:23:01.587248 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Jul 25 21:23:01.587248 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 406/787] 10.222.0.66 () {56 vars in 1114 bytes} [Mon Jul 25 21:23:01 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:23:01.588235 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e0fe3b-9995-406e-8455-18ebbf8e8892 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:23:01.707171 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e0fe3b-9995-406e-8455-18ebbf8e8892 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:23:01.744561 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd23a86a-fa58-49ab-8744-9d3e7e28f799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:23:01.745219 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd23a86a-fa58-49ab-8744-9d3e7e28f799 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:23:01.745495 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd23a86a-fa58-49ab-8744-9d3e7e28f799 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:23:01.745759 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd23a86a-fa58-49ab-8744-9d3e7e28f799 None admin] PATH_INFO: `/v3/services` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:23:01.746433 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd23a86a-fa58-49ab-8744-9d3e7e28f799 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:23:01.746728 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd23a86a-fa58-49ab-8744-9d3e7e28f799 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:23:01.748105 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd23a86a-fa58-49ab-8744-9d3e7e28f799 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:23:01.752833 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 382/788] 10.222.0.66 () {56 vars in 1114 bytes} [Mon Jul 25 21:23:01 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:23:01.759322 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a48d2ba-abbe-4370-a30f-36cfcb926680 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:23:01.819748 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:23:01.864757 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a48d2ba-abbe-4370-a30f-36cfcb926680 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:23:01.899326 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0462d813-8ca6-4fbf-96bb-3c8d78fc9afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:23:01.899939 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0462d813-8ca6-4fbf-96bb-3c8d78fc9afc None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:23:01.900212 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0462d813-8ca6-4fbf-96bb-3c8d78fc9afc None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:23:01.900482 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0462d813-8ca6-4fbf-96bb-3c8d78fc9afc None admin] PATH_INFO: `/v3/services` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:23:01.901175 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0462d813-8ca6-4fbf-96bb-3c8d78fc9afc None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:23:01.901474 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0462d813-8ca6-4fbf-96bb-3c8d78fc9afc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:23:01.902852 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0462d813-8ca6-4fbf-96bb-3c8d78fc9afc None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:23:01.907701 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 407/789] 10.222.0.66 () {56 vars in 1114 bytes} [Mon Jul 25 21:23:01 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:23:01.913486 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd23a86a-fa58-49ab-8744-9d3e7e28f799 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:23:01.965145 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:23:02.025074 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd23a86a-fa58-49ab-8744-9d3e7e28f799 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:23:02.061381 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68169935-ba9f-41ce-9b3e-479caf9edc45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:23:02.062001 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68169935-ba9f-41ce-9b3e-479caf9edc45 None admin] REQUEST_METHOD: `POST` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:23:02.062273 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68169935-ba9f-41ce-9b3e-479caf9edc45 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:23:02.062539 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68169935-ba9f-41ce-9b3e-479caf9edc45 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:23:02.063351 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68169935-ba9f-41ce-9b3e-479caf9edc45 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:23:02.064805 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68169935-ba9f-41ce-9b3e-479caf9edc45 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:23:02.087430 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 383/790] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Jul 25 21:23:01 2022] POST /identity/v3/endpoints => generated 346 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 21:23:03.810827 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0393fd85-d9e1-4749-92bc-1730679690d7 None None] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:23:03.811426 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0393fd85-d9e1-4749-92bc-1730679690d7 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:23:03.811426 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0393fd85-d9e1-4749-92bc-1730679690d7 None None] PATH_INFO: `/` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:23:03.812690 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 408/791] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:23:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:23:03.818215 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f6aee7-59f8-4b52-b068-38b5e28be279 None None] REQUEST_METHOD: `POST` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:23:03.818627 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f6aee7-59f8-4b52-b068-38b5e28be279 None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:23:03.818867 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f6aee7-59f8-4b52-b068-38b5e28be279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:23:03.837888 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.auth.core [None req-e4f6aee7-59f8-4b52-b068-38b5e28be279 None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:23:03.839073 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.fernet_utils [None req-e4f6aee7-59f8-4b52-b068-38b5e28be279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:23:03.923741 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 384/792] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:23:03 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 21:23:03.947809 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0393fd85-d9e1-4749-92bc-1730679690d7 None None] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:23:04.056224 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0393fd85-d9e1-4749-92bc-1730679690d7 None None] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:23:04.075205 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:23:04.094661 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4881b37d-0cf7-4de4-97bb-4cccee641e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:23:04.095312 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4881b37d-0cf7-4de4-97bb-4cccee641e8a None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:23:04.095593 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4881b37d-0cf7-4de4-97bb-4cccee641e8a None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:23:04.095948 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4881b37d-0cf7-4de4-97bb-4cccee641e8a None admin] PATH_INFO: `/v3/services/compute` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:23:04.096566 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4881b37d-0cf7-4de4-97bb-4cccee641e8a None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:23:04.098057 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4881b37d-0cf7-4de4-97bb-4cccee641e8a None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:23:04.107044 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application [None req-4881b37d-0cf7-4de4-97bb-4cccee641e8a None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 21:23:04.107044 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:23:04.107044 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 21:23:04.107044 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 21:23:04.107044 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 21:23:04.107044 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 21:23:04.107044 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 21:23:04.107044 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 21:23:04.107044 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 21:23:04.107044 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Jul 25 21:23:04.107044 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 21:23:04.107044 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Jul 25 21:23:04.107044 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:23:04.107044 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:23:04.107044 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:23:04.107044 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:23:04.107044 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:23:04.108255 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:23:04.108255 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:23:04.108255 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:23:04.108255 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:23:04.108255 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:23:04.108255 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:23:04.108255 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 21:23:04.108255 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 21:23:04.108255 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 21:23:04.108255 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 21:23:04.108255 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:23:04.108255 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:23:04.108255 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:23:04.108255 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:23:04.108255 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:23:04.108255 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:23:04.109131 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:23:04.109131 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application with Lock( Jul 25 21:23:04.109131 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:23:04.109131 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:23:04.109131 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:23:04.109131 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:23:04.109131 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:23:04.109131 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:23:04.109131 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:23:04.109131 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:23:04.109131 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 21:23:04.109131 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 21:23:04.109131 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 21:23:04.109131 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Jul 25 21:23:04.109131 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 409/793] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Jul 25 21:23:03 2022] GET /identity/v3/services/compute => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:23:04.114738 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f6aee7-59f8-4b52-b068-38b5e28be279 None None] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:23:04.141845 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:23:04.224464 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f6aee7-59f8-4b52-b068-38b5e28be279 None None] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:23:04.259920 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7419afbf-4a89-49b5-a7f0-77a67f6fa879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:23:04.260541 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7419afbf-4a89-49b5-a7f0-77a67f6fa879 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:23:04.260819 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7419afbf-4a89-49b5-a7f0-77a67f6fa879 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:23:04.261109 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7419afbf-4a89-49b5-a7f0-77a67f6fa879 None admin] PATH_INFO: `/v3/services` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:23:04.261800 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7419afbf-4a89-49b5-a7f0-77a67f6fa879 None admin] RBAC: Adding query filter params (name=compute) {{(pid=87210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:23:04.262077 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7419afbf-4a89-49b5-a7f0-77a67f6fa879 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:23:04.263470 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7419afbf-4a89-49b5-a7f0-77a67f6fa879 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:23:04.268338 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 385/794] 10.222.0.66 () {56 vars in 1112 bytes} [Mon Jul 25 21:23:04 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:23:04.274235 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4881b37d-0cf7-4de4-97bb-4cccee641e8a None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:23:04.346006 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157be53d-b381-437d-a270-baa01f39d657 None None] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:23:04.346236 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157be53d-b381-437d-a270-baa01f39d657 None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:23:04.346462 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157be53d-b381-437d-a270-baa01f39d657 None None] PATH_INFO: `/` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:23:04.347854 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 386/795] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:23:04 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:23:04.355361 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b72d72-e0bb-48c0-89e3-b36456a3e9ee None None] REQUEST_METHOD: `POST` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:23:04.355725 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b72d72-e0bb-48c0-89e3-b36456a3e9ee None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:23:04.356054 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b72d72-e0bb-48c0-89e3-b36456a3e9ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:23:04.378142 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.auth.core [None req-80b72d72-e0bb-48c0-89e3-b36456a3e9ee None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:23:04.379340 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.fernet_utils [None req-80b72d72-e0bb-48c0-89e3-b36456a3e9ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:23:04.393438 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4881b37d-0cf7-4de4-97bb-4cccee641e8a None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:23:04.429177 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299ecef4-dde6-4b69-8f64-82311fd94e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:23:04.429796 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299ecef4-dde6-4b69-8f64-82311fd94e6f None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:23:04.430068 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299ecef4-dde6-4b69-8f64-82311fd94e6f None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:23:04.430335 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299ecef4-dde6-4b69-8f64-82311fd94e6f None admin] PATH_INFO: `/v3/services` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:23:04.431024 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299ecef4-dde6-4b69-8f64-82311fd94e6f None admin] RBAC: Adding query filter params (type=compute) {{(pid=87209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:23:04.431319 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299ecef4-dde6-4b69-8f64-82311fd94e6f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:23:04.432699 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299ecef4-dde6-4b69-8f64-82311fd94e6f None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:23:04.437348 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 410/796] 10.222.0.66 () {56 vars in 1112 bytes} [Mon Jul 25 21:23:04 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:23:04.448655 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 387/797] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:23:04 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 21:23:04.474475 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299ecef4-dde6-4b69-8f64-82311fd94e6f None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:23:04.525861 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:23:04.587710 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299ecef4-dde6-4b69-8f64-82311fd94e6f None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:23:04.627114 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b11859-84a2-406a-9faf-82f761a2eb54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:23:04.627668 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b11859-84a2-406a-9faf-82f761a2eb54 None admin] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:23:04.627948 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b11859-84a2-406a-9faf-82f761a2eb54 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:23:04.628226 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b11859-84a2-406a-9faf-82f761a2eb54 None admin] PATH_INFO: `/v3/projects` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:23:04.628921 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b11859-84a2-406a-9faf-82f761a2eb54 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:23:04.630404 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b11859-84a2-406a-9faf-82f761a2eb54 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:23:04.633057 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: WARNING keystone.server.flask.common [None req-34b11859-84a2-406a-9faf-82f761a2eb54 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 25 21:23:04.651757 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.sql.core [None req-34b11859-84a2-406a-9faf-82f761a2eb54 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 25 21:23:04.651757 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 25 21:23:04.651757 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [parameters: {'id': 'ad44e57480a548a6860f4cbe1384f267', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 25 21:23:04.651757 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87209) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 25 21:23:04.668871 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application [None req-34b11859-84a2-406a-9faf-82f761a2eb54 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ad44e57480a548a6860f4cbe1384f267.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ad44e57480a548a6860f4cbe1384f267. Jul 25 21:23:04.668871 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:23:04.668871 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 25 21:23:04.668871 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 25 21:23:04.668871 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 25 21:23:04.668871 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 25 21:23:04.668871 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 25 21:23:04.668871 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application result = self._query(query) Jul 25 21:23:04.668871 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 25 21:23:04.668871 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application conn.query(q) Jul 25 21:23:04.668871 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 25 21:23:04.668871 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 25 21:23:04.668871 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 25 21:23:04.669927 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application result.read() Jul 25 21:23:04.669927 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 25 21:23:04.669927 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 25 21:23:04.669927 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 25 21:23:04.669927 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 25 21:23:04.669927 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 25 21:23:04.669927 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 25 21:23:04.669927 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 25 21:23:04.669927 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 25 21:23:04.669927 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 25 21:23:04.669927 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Jul 25 21:23:04.669927 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 25 21:23:04.669927 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Jul 25 21:23:04.669927 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:23:04.669927 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 25 21:23:04.669927 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 25 21:23:04.669927 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 25 21:23:04.669927 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 25 21:23:04.671086 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 25 21:23:04.671086 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application next(self.gen) Jul 25 21:23:04.671086 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 25 21:23:04.671086 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application yield resource Jul 25 21:23:04.671086 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 25 21:23:04.671086 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application next(self.gen) Jul 25 21:23:04.671086 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 25 21:23:04.671086 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application self.session.rollback() Jul 25 21:23:04.671086 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 21:23:04.671086 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application self.force_reraise() Jul 25 21:23:04.671086 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 21:23:04.671086 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application raise self.value Jul 25 21:23:04.671086 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 25 21:23:04.671086 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 25 21:23:04.671086 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 25 21:23:04.671086 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application session.commit() Jul 25 21:23:04.671086 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 25 21:23:04.672586 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 25 21:23:04.672586 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 25 21:23:04.672586 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application self._prepare_impl() Jul 25 21:23:04.672586 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 25 21:23:04.672586 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application self.session.flush() Jul 25 21:23:04.672586 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 25 21:23:04.672586 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application self._flush(objects) Jul 25 21:23:04.672586 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 25 21:23:04.672586 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 25 21:23:04.672586 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 25 21:23:04.672586 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application compat.raise_( Jul 25 21:23:04.672586 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 25 21:23:04.672586 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application raise exception Jul 25 21:23:04.672586 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 25 21:23:04.672586 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application flush_context.execute() Jul 25 21:23:04.672586 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 25 21:23:04.672586 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application rec.execute(self) Jul 25 21:23:04.673947 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 25 21:23:04.673947 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 25 21:23:04.673947 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 25 21:23:04.673947 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 25 21:23:04.673947 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 25 21:23:04.673947 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 25 21:23:04.673947 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 25 21:23:04.673947 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 25 21:23:04.673947 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 25 21:23:04.673947 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 25 21:23:04.673947 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 25 21:23:04.673947 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 25 21:23:04.673947 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 25 21:23:04.673947 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 25 21:23:04.673947 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 25 21:23:04.675144 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 25 21:23:04.675144 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 25 21:23:04.675144 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application raise exception Jul 25 21:23:04.675144 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 25 21:23:04.675144 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 25 21:23:04.675144 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 25 21:23:04.675144 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 25 21:23:04.675144 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 25 21:23:04.675144 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application result = self._query(query) Jul 25 21:23:04.675144 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 25 21:23:04.675144 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application conn.query(q) Jul 25 21:23:04.675144 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 25 21:23:04.675144 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 25 21:23:04.675144 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 25 21:23:04.675144 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application result.read() Jul 25 21:23:04.675144 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 25 21:23:04.675144 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 25 21:23:04.676522 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 25 21:23:04.676522 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 25 21:23:04.676522 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 25 21:23:04.676522 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 25 21:23:04.676522 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 25 21:23:04.676522 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 25 21:23:04.676522 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 25 21:23:04.676522 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 25 21:23:04.676522 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application [parameters: {'id': 'ad44e57480a548a6860f4cbe1384f267', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 25 21:23:04.676522 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 25 21:23:04.676522 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Jul 25 21:23:04.676522 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 21:23:04.676522 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Jul 25 21:23:04.676522 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:23:04.676522 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 25 21:23:04.677644 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 25 21:23:04.677644 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 25 21:23:04.677644 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 25 21:23:04.677644 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 25 21:23:04.677644 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Jul 25 21:23:04.677644 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 21:23:04.677644 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Jul 25 21:23:04.677644 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:23:04.677644 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:23:04.677644 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:23:04.677644 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:23:04.677644 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:23:04.677644 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:23:04.677644 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:23:04.677644 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:23:04.677644 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:23:04.677644 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:23:04.678805 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:23:04.678805 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 25 21:23:04.678805 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 25 21:23:04.678805 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:23:04.678805 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:23:04.678805 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 25 21:23:04.678805 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 25 21:23:04.678805 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ad44e57480a548a6860f4cbe1384f267. Jul 25 21:23:04.678805 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Jul 25 21:23:04.678805 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 411/798] 10.222.0.66 () {60 vars in 1140 bytes} [Mon Jul 25 21:23:04 2022] POST /identity/v3/projects => generated 262 bytes in 196 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:23:04.679681 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b72d72-e0bb-48c0-89e3-b36456a3e9ee None None] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:23:04.699744 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:23:04.787521 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b72d72-e0bb-48c0-89e3-b36456a3e9ee None None] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:23:04.825347 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4271c4cc-7f25-4271-8377-051a2ad76713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:23:04.826071 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4271c4cc-7f25-4271-8377-051a2ad76713 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:23:04.826259 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4271c4cc-7f25-4271-8377-051a2ad76713 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:23:04.826525 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4271c4cc-7f25-4271-8377-051a2ad76713 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:23:04.833451 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4271c4cc-7f25-4271-8377-051a2ad76713 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:23:04.834908 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4271c4cc-7f25-4271-8377-051a2ad76713 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:23:04.846104 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application [None req-4271c4cc-7f25-4271-8377-051a2ad76713 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:23:04.846104 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:23:04.846104 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:23:04.846104 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:23:04.846104 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:23:04.846104 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:23:04.846104 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:23:04.846104 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:23:04.846104 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:23:04.846104 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:23:04.846104 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:23:04.846104 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:23:04.846104 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 21:23:04.846104 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 21:23:04.846104 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 21:23:04.847462 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 21:23:04.847462 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:23:04.847462 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:23:04.847462 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:23:04.847462 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:23:04.847462 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:23:04.847462 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:23:04.847462 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:23:04.847462 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application with Lock( Jul 25 21:23:04.847462 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:23:04.847462 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:23:04.847462 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:23:04.847462 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:23:04.847462 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:23:04.847462 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:23:04.847462 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:23:04.847462 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:23:04.848673 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 21:23:04.848673 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 21:23:04.848673 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 21:23:04.848673 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 21:23:04.848673 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 21:23:04.848673 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 21:23:04.848673 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:23:04.848673 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Jul 25 21:23:04.848673 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 388/799] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Jul 25 21:23:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:23:04.853980 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b11859-84a2-406a-9faf-82f761a2eb54 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:23:04.967082 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b11859-84a2-406a-9faf-82f761a2eb54 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:23:04.968776 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:23:05.004519 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f88ebda-c82a-404d-abf1-fff71883a8cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:23:05.005309 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f88ebda-c82a-404d-abf1-fff71883a8cc None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:23:05.005584 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f88ebda-c82a-404d-abf1-fff71883a8cc None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:23:05.005837 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f88ebda-c82a-404d-abf1-fff71883a8cc None admin] PATH_INFO: `/v3/projects` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:23:05.006580 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f88ebda-c82a-404d-abf1-fff71883a8cc None admin] RBAC: Adding query filter params (name=service) {{(pid=87209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:23:05.006875 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f88ebda-c82a-404d-abf1-fff71883a8cc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:23:05.008521 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f88ebda-c82a-404d-abf1-fff71883a8cc None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:23:05.037110 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 412/800] 10.222.0.66 () {56 vars in 1112 bytes} [Mon Jul 25 21:23:04 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:23:06.714223 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d3dea9-99b3-480a-ac74-10d5d910362c None None] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:23:06.714795 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d3dea9-99b3-480a-ac74-10d5d910362c None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:23:06.714795 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d3dea9-99b3-480a-ac74-10d5d910362c None None] PATH_INFO: `/` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:23:06.716133 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 389/801] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:23:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:23:06.722142 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f705a3e8-5389-4c40-bd84-29f3ff58e7d6 None None] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:23:06.722637 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f705a3e8-5389-4c40-bd84-29f3ff58e7d6 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:23:06.722752 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f705a3e8-5389-4c40-bd84-29f3ff58e7d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:23:06.742191 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.auth.core [None req-f705a3e8-5389-4c40-bd84-29f3ff58e7d6 None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:23:06.743720 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-f705a3e8-5389-4c40-bd84-29f3ff58e7d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:23:06.814966 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 413/802] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:23:06 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 21:23:06.838754 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d3dea9-99b3-480a-ac74-10d5d910362c None None] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:23:06.923039 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:23:06.944666 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d3dea9-99b3-480a-ac74-10d5d910362c None None] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:23:06.980811 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32603baf-a0d3-4804-a4cb-5dfe07ea349d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:23:06.981467 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32603baf-a0d3-4804-a4cb-5dfe07ea349d None admin] REQUEST_METHOD: `POST` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:23:06.981743 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32603baf-a0d3-4804-a4cb-5dfe07ea349d None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:23:06.982010 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32603baf-a0d3-4804-a4cb-5dfe07ea349d None admin] PATH_INFO: `/v3/services` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:23:06.982703 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32603baf-a0d3-4804-a4cb-5dfe07ea349d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:23:06.984076 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32603baf-a0d3-4804-a4cb-5dfe07ea349d None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:23:07.000258 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 390/803] 10.222.0.66 () {60 vars in 1141 bytes} [Mon Jul 25 21:23:06 2022] POST /identity/v3/services => generated 242 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 21:23:07.304531 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986275ff-06e1-450f-9a19-50ce23da6c4d None None] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:23:07.304896 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986275ff-06e1-450f-9a19-50ce23da6c4d None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:23:07.305386 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986275ff-06e1-450f-9a19-50ce23da6c4d None None] PATH_INFO: `/` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:23:07.307619 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 414/804] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:23:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:23:07.316850 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4633e367-bbe8-46bc-b23f-877d316729dd None None] REQUEST_METHOD: `POST` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:23:07.317329 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4633e367-bbe8-46bc-b23f-877d316729dd None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:23:07.317773 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4633e367-bbe8-46bc-b23f-877d316729dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:23:07.341024 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.auth.core [None req-4633e367-bbe8-46bc-b23f-877d316729dd None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:23:07.342259 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.fernet_utils [None req-4633e367-bbe8-46bc-b23f-877d316729dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:23:07.419992 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 391/805] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:23:07 2022] POST /identity/v3/auth/tokens => generated 1703 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 21:23:07.447176 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986275ff-06e1-450f-9a19-50ce23da6c4d None None] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:23:07.546563 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:23:07.558006 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986275ff-06e1-450f-9a19-50ce23da6c4d None None] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:23:07.592248 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6af13a-a1e0-4773-a47c-282c42ca30b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:23:07.592877 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6af13a-a1e0-4773-a47c-282c42ca30b9 None admin] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:23:07.593204 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6af13a-a1e0-4773-a47c-282c42ca30b9 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:23:07.593480 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6af13a-a1e0-4773-a47c-282c42ca30b9 None admin] PATH_INFO: `/v3/users` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:23:07.594166 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6af13a-a1e0-4773-a47c-282c42ca30b9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:23:07.595732 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6af13a-a1e0-4773-a47c-282c42ca30b9 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:23:07.611641 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.sql.core [None req-db6af13a-a1e0-4773-a47c-282c42ca30b9 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 25 21:23:07.611641 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 25 21:23:07.611641 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [parameters: {'user_id': '5d5d0fc206d74b6b9559a2ed51cc9d0a', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 25 21:23:07.611641 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87209) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 25 21:23:07.620587 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application [None req-db6af13a-a1e0-4773-a47c-282c42ca30b9 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 25 21:23:07.620587 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:23:07.620587 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 25 21:23:07.620587 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 25 21:23:07.620587 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 25 21:23:07.620587 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 25 21:23:07.620587 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 25 21:23:07.620587 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application result = self._query(query) Jul 25 21:23:07.620587 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 25 21:23:07.620587 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application conn.query(q) Jul 25 21:23:07.620587 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 25 21:23:07.620587 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 25 21:23:07.620587 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 25 21:23:07.620587 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application result.read() Jul 25 21:23:07.620587 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 25 21:23:07.621482 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 25 21:23:07.621482 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 25 21:23:07.621482 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 25 21:23:07.621482 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 25 21:23:07.621482 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 25 21:23:07.621482 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 25 21:23:07.621482 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 25 21:23:07.621482 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 25 21:23:07.621482 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Jul 25 21:23:07.621482 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 25 21:23:07.621482 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Jul 25 21:23:07.621482 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:23:07.621482 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 25 21:23:07.621482 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 25 21:23:07.621482 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 25 21:23:07.621482 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 25 21:23:07.621482 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 25 21:23:07.621482 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application next(self.gen) Jul 25 21:23:07.622498 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 25 21:23:07.622498 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application yield resource Jul 25 21:23:07.622498 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 25 21:23:07.622498 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application next(self.gen) Jul 25 21:23:07.622498 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 25 21:23:07.622498 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application self.session.rollback() Jul 25 21:23:07.622498 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 21:23:07.622498 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application self.force_reraise() Jul 25 21:23:07.622498 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 21:23:07.622498 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application raise self.value Jul 25 21:23:07.622498 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 25 21:23:07.622498 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 25 21:23:07.622498 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 25 21:23:07.622498 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application session.commit() Jul 25 21:23:07.622498 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 25 21:23:07.622498 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 25 21:23:07.622498 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 25 21:23:07.623392 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application self._prepare_impl() Jul 25 21:23:07.623392 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 25 21:23:07.623392 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application self.session.flush() Jul 25 21:23:07.623392 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 25 21:23:07.623392 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application self._flush(objects) Jul 25 21:23:07.623392 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 25 21:23:07.623392 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 25 21:23:07.623392 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 25 21:23:07.623392 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application compat.raise_( Jul 25 21:23:07.623392 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 25 21:23:07.623392 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application raise exception Jul 25 21:23:07.623392 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 25 21:23:07.623392 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application flush_context.execute() Jul 25 21:23:07.623392 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 25 21:23:07.623392 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application rec.execute(self) Jul 25 21:23:07.623392 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 25 21:23:07.623392 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 25 21:23:07.624320 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 25 21:23:07.624320 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 25 21:23:07.624320 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 25 21:23:07.624320 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 25 21:23:07.624320 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 25 21:23:07.624320 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 25 21:23:07.624320 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 25 21:23:07.624320 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 25 21:23:07.624320 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 25 21:23:07.624320 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 25 21:23:07.624320 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 25 21:23:07.624320 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 25 21:23:07.624320 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 25 21:23:07.624320 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 25 21:23:07.624320 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 25 21:23:07.624320 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application raise exception Jul 25 21:23:07.625241 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 25 21:23:07.625241 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 25 21:23:07.625241 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 25 21:23:07.625241 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 25 21:23:07.625241 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 25 21:23:07.625241 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application result = self._query(query) Jul 25 21:23:07.625241 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 25 21:23:07.625241 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application conn.query(q) Jul 25 21:23:07.625241 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 25 21:23:07.625241 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 25 21:23:07.625241 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 25 21:23:07.625241 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application result.read() Jul 25 21:23:07.625241 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 25 21:23:07.625241 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 25 21:23:07.625241 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 25 21:23:07.625241 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 25 21:23:07.626092 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 25 21:23:07.626092 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 25 21:23:07.626092 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 25 21:23:07.626092 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 25 21:23:07.626092 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 25 21:23:07.626092 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 25 21:23:07.626092 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application [parameters: {'user_id': '5d5d0fc206d74b6b9559a2ed51cc9d0a', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 25 21:23:07.626092 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 25 21:23:07.626092 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Jul 25 21:23:07.626092 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 21:23:07.626092 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Jul 25 21:23:07.626092 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:23:07.626092 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:23:07.626092 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:23:07.626092 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:23:07.627242 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:23:07.627242 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:23:07.627242 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:23:07.627242 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:23:07.627242 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:23:07.627242 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:23:07.627242 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:23:07.627242 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 25 21:23:07.627242 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 25 21:23:07.627242 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:23:07.627242 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:23:07.627242 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 21:23:07.627242 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:23:07.627242 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 21:23:07.627242 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:23:07.627242 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 25 21:23:07.627242 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 25 21:23:07.628188 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 25 21:23:07.628188 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 25 21:23:07.628188 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 25 21:23:07.628188 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 25 21:23:07.628188 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 25 21:23:07.628188 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Jul 25 21:23:07.628188 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 415/806] 10.222.0.66 () {60 vars in 1131 bytes} [Mon Jul 25 21:23:07 2022] POST /identity/v3/users => generated 160 bytes in 175 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:23:07.628594 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4633e367-bbe8-46bc-b23f-877d316729dd None None] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:23:07.694024 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:23:07.733217 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4633e367-bbe8-46bc-b23f-877d316729dd None None] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:23:07.769752 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f10fb54-1d70-49c5-96b2-56284f29dec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:23:07.770408 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f10fb54-1d70-49c5-96b2-56284f29dec7 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:23:07.770685 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f10fb54-1d70-49c5-96b2-56284f29dec7 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:23:07.770956 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f10fb54-1d70-49c5-96b2-56284f29dec7 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:23:07.778404 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f10fb54-1d70-49c5-96b2-56284f29dec7 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:23:07.779870 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f10fb54-1d70-49c5-96b2-56284f29dec7 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:23:07.792413 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application [None req-6f10fb54-1d70-49c5-96b2-56284f29dec7 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 21:23:07.792413 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:23:07.792413 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:23:07.792413 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:23:07.792413 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:23:07.792413 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:23:07.792413 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:23:07.792413 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:23:07.792413 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:23:07.792413 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:23:07.792413 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:23:07.792413 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:23:07.792413 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 21:23:07.792413 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 21:23:07.792413 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 21:23:07.792413 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 21:23:07.793404 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:23:07.793404 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:23:07.793404 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 21:23:07.793404 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:23:07.793404 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 21:23:07.793404 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:23:07.793404 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:23:07.793404 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:23:07.793404 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:23:07.793404 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:23:07.793404 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:23:07.793404 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application with Lock( Jul 25 21:23:07.793404 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:23:07.793404 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:23:07.793404 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:23:07.793404 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:23:07.793404 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:23:07.793404 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:23:07.794356 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:23:07.794356 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:23:07.794356 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 21:23:07.794356 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 21:23:07.794356 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 21:23:07.794356 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 21:23:07.794356 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 21:23:07.794356 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 21:23:07.794356 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 21:23:07.794356 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Jul 25 21:23:07.794356 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 392/807] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Jul 25 21:23:07 2022] GET /identity/v3/users/cinder => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:23:07.800533 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6af13a-a1e0-4773-a47c-282c42ca30b9 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:23:07.905558 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6af13a-a1e0-4773-a47c-282c42ca30b9 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:23:07.941441 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b243a7-db96-4c04-b3ae-9cdefd72cdb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:23:07.942061 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b243a7-db96-4c04-b3ae-9cdefd72cdb4 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:23:07.942337 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b243a7-db96-4c04-b3ae-9cdefd72cdb4 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:23:07.942607 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b243a7-db96-4c04-b3ae-9cdefd72cdb4 None admin] PATH_INFO: `/v3/users` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:23:07.943357 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b243a7-db96-4c04-b3ae-9cdefd72cdb4 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=87209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:23:07.943656 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b243a7-db96-4c04-b3ae-9cdefd72cdb4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:23:07.945316 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b243a7-db96-4c04-b3ae-9cdefd72cdb4 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:23:07.983561 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 416/808] 10.222.0.66 () {56 vars in 1101 bytes} [Mon Jul 25 21:23:07 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:23:09.260004 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c6cab2-b509-49d6-8ccf-7c46cd03cedd None None] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:23:09.260740 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c6cab2-b509-49d6-8ccf-7c46cd03cedd None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:23:09.260740 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c6cab2-b509-49d6-8ccf-7c46cd03cedd None None] PATH_INFO: `/` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:23:09.262872 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 393/809] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:23:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:23:09.269679 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a07c73-bf87-4b41-b296-5db6a141ba81 None None] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:23:09.270407 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a07c73-bf87-4b41-b296-5db6a141ba81 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:23:09.270556 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a07c73-bf87-4b41-b296-5db6a141ba81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:23:09.295006 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.auth.core [None req-61a07c73-bf87-4b41-b296-5db6a141ba81 None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:23:09.296525 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-61a07c73-bf87-4b41-b296-5db6a141ba81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:23:09.304021 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:23:09.368486 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 417/810] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:23:09 2022] POST /identity/v3/auth/tokens => generated 1703 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 21:23:09.402651 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c6cab2-b509-49d6-8ccf-7c46cd03cedd None None] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:23:09.517505 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c6cab2-b509-49d6-8ccf-7c46cd03cedd None None] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:23:09.546169 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:23:09.557171 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b4e3f7-af98-4c00-8d35-63e57d807115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:23:09.557820 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b4e3f7-af98-4c00-8d35-63e57d807115 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:23:09.558095 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b4e3f7-af98-4c00-8d35-63e57d807115 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:23:09.558359 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b4e3f7-af98-4c00-8d35-63e57d807115 None admin] PATH_INFO: `/v3/services/compute` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:23:09.559008 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b4e3f7-af98-4c00-8d35-63e57d807115 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:23:09.560394 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b4e3f7-af98-4c00-8d35-63e57d807115 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:23:09.569349 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application [None req-18b4e3f7-af98-4c00-8d35-63e57d807115 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 21:23:09.569349 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:23:09.569349 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 21:23:09.569349 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 21:23:09.569349 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 21:23:09.569349 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 21:23:09.569349 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 21:23:09.569349 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 21:23:09.569349 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 21:23:09.569349 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Jul 25 21:23:09.569349 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 21:23:09.569349 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Jul 25 21:23:09.569349 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:23:09.569349 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:23:09.569349 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:23:09.569349 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:23:09.569349 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:23:09.570344 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:23:09.570344 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:23:09.570344 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:23:09.570344 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:23:09.570344 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:23:09.570344 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:23:09.570344 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 21:23:09.570344 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 21:23:09.570344 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 21:23:09.570344 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 21:23:09.570344 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:23:09.570344 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:23:09.570344 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:23:09.570344 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:23:09.570344 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:23:09.570344 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:23:09.571322 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:23:09.571322 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application with Lock( Jul 25 21:23:09.571322 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:23:09.571322 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:23:09.571322 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:23:09.571322 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:23:09.571322 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:23:09.571322 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:23:09.571322 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:23:09.571322 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:23:09.571322 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 21:23:09.571322 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 21:23:09.571322 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 21:23:09.571322 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Jul 25 21:23:09.571322 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 394/811] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Jul 25 21:23:09 2022] GET /identity/v3/services/compute => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:23:09.576777 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a07c73-bf87-4b41-b296-5db6a141ba81 None None] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:23:09.684075 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a07c73-bf87-4b41-b296-5db6a141ba81 None None] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:23:09.727451 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad491da-d454-48cd-9af2-f1b963164c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:23:09.728070 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad491da-d454-48cd-9af2-f1b963164c32 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:23:09.728350 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad491da-d454-48cd-9af2-f1b963164c32 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:23:09.728618 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad491da-d454-48cd-9af2-f1b963164c32 None admin] PATH_INFO: `/v3/services` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:23:09.729322 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad491da-d454-48cd-9af2-f1b963164c32 None admin] RBAC: Adding query filter params (name=compute) {{(pid=87209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:23:09.729625 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad491da-d454-48cd-9af2-f1b963164c32 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:23:09.731012 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad491da-d454-48cd-9af2-f1b963164c32 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:23:09.736674 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 418/812] 10.222.0.66 () {56 vars in 1112 bytes} [Mon Jul 25 21:23:09 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:23:09.745656 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b4e3f7-af98-4c00-8d35-63e57d807115 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:23:09.847338 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b4e3f7-af98-4c00-8d35-63e57d807115 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:23:09.882329 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f291d97-7244-4447-8a02-c0258b78bd5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:23:09.882951 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f291d97-7244-4447-8a02-c0258b78bd5e None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:23:09.883222 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f291d97-7244-4447-8a02-c0258b78bd5e None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:23:09.883485 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f291d97-7244-4447-8a02-c0258b78bd5e None admin] PATH_INFO: `/v3/services` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:23:09.884165 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f291d97-7244-4447-8a02-c0258b78bd5e None admin] RBAC: Adding query filter params (type=compute) {{(pid=87210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:23:09.884466 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f291d97-7244-4447-8a02-c0258b78bd5e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:23:09.885858 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f291d97-7244-4447-8a02-c0258b78bd5e None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:23:09.890738 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 395/813] 10.222.0.66 () {56 vars in 1112 bytes} [Mon Jul 25 21:23:09 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:23:09.897231 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad491da-d454-48cd-9af2-f1b963164c32 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:23:09.906683 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:23:10.004745 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad491da-d454-48cd-9af2-f1b963164c32 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:23:10.040961 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e81e718-1f1c-456f-80c6-e8bdab07ad08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:23:10.041607 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e81e718-1f1c-456f-80c6-e8bdab07ad08 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:23:10.041881 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e81e718-1f1c-456f-80c6-e8bdab07ad08 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:23:10.042152 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e81e718-1f1c-456f-80c6-e8bdab07ad08 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:23:10.042895 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e81e718-1f1c-456f-80c6-e8bdab07ad08 None admin] RBAC: Adding query filter params (interface=public, service_id=9465881c0a9d4aebac683150e786ec3b, region_id=RegionOne) {{(pid=87209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:23:10.043197 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e81e718-1f1c-456f-80c6-e8bdab07ad08 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:23:10.044594 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e81e718-1f1c-456f-80c6-e8bdab07ad08 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:23:10.049832 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 419/814] 10.222.0.66 () {56 vars in 1251 bytes} [Mon Jul 25 21:23:09 2022] GET /identity/v3/endpoints?service_id=9465881c0a9d4aebac683150e786ec3b&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:23:10.055740 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f291d97-7244-4447-8a02-c0258b78bd5e None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:23:10.118974 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:23:10.174544 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f291d97-7244-4447-8a02-c0258b78bd5e None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:23:10.214414 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b37ab9-1772-45b3-9e30-bea6ed35d220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:23:10.215040 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b37ab9-1772-45b3-9e30-bea6ed35d220 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:23:10.215315 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b37ab9-1772-45b3-9e30-bea6ed35d220 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:23:10.215555 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b37ab9-1772-45b3-9e30-bea6ed35d220 None admin] PATH_INFO: `/v3/services` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:23:10.216235 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b37ab9-1772-45b3-9e30-bea6ed35d220 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:23:10.217657 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b37ab9-1772-45b3-9e30-bea6ed35d220 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:23:10.224317 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 396/815] 10.222.0.66 () {56 vars in 1087 bytes} [Mon Jul 25 21:23:10 2022] GET /identity/v3/services => generated 1728 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 21:23:12.455276 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6360116-9bb7-459d-9f04-b715fe812e2f None None] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:23:12.455848 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6360116-9bb7-459d-9f04-b715fe812e2f None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:23:12.455848 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6360116-9bb7-459d-9f04-b715fe812e2f None None] PATH_INFO: `/` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:23:12.457260 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 420/816] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:23:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:23:12.463597 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7fd8e2-4c79-4a77-a095-b910cede6d0d None None] REQUEST_METHOD: `POST` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:23:12.464320 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7fd8e2-4c79-4a77-a095-b910cede6d0d None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:23:12.464476 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7fd8e2-4c79-4a77-a095-b910cede6d0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:23:12.493392 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.auth.core [None req-fd7fd8e2-4c79-4a77-a095-b910cede6d0d None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:23:12.494529 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.fernet_utils [None req-fd7fd8e2-4c79-4a77-a095-b910cede6d0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:23:12.567929 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 397/817] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:23:12 2022] POST /identity/v3/auth/tokens => generated 1703 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 21:23:12.600098 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6360116-9bb7-459d-9f04-b715fe812e2f None None] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:23:12.690644 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:23:12.738205 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6360116-9bb7-459d-9f04-b715fe812e2f None None] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:23:12.773453 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db037794-c48b-4d7b-8736-da6e81a9216f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:23:12.774091 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db037794-c48b-4d7b-8736-da6e81a9216f None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:23:12.774369 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db037794-c48b-4d7b-8736-da6e81a9216f None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:23:12.774642 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db037794-c48b-4d7b-8736-da6e81a9216f None admin] PATH_INFO: `/v3/services/compute` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:23:12.775261 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db037794-c48b-4d7b-8736-da6e81a9216f None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:23:12.776664 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db037794-c48b-4d7b-8736-da6e81a9216f None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:23:12.786047 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application [None req-db037794-c48b-4d7b-8736-da6e81a9216f None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 21:23:12.786047 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:23:12.786047 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 21:23:12.786047 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 21:23:12.786047 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 21:23:12.786047 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 21:23:12.786047 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 21:23:12.786047 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 21:23:12.786047 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 21:23:12.786047 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Jul 25 21:23:12.786047 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 21:23:12.786047 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Jul 25 21:23:12.786047 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:23:12.786047 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:23:12.786047 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:23:12.786047 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:23:12.786047 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:23:12.787143 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:23:12.787143 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:23:12.787143 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:23:12.787143 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:23:12.787143 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:23:12.787143 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:23:12.787143 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 21:23:12.787143 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 21:23:12.787143 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 21:23:12.787143 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 21:23:12.787143 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:23:12.787143 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:23:12.787143 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:23:12.787143 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:23:12.787143 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:23:12.787143 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:23:12.788083 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:23:12.788083 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application with Lock( Jul 25 21:23:12.788083 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:23:12.788083 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:23:12.788083 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:23:12.788083 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:23:12.788083 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:23:12.788083 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:23:12.788083 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:23:12.788083 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:23:12.788083 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 21:23:12.788083 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 21:23:12.788083 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 21:23:12.788083 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Jul 25 21:23:12.788083 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 421/818] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Jul 25 21:23:12 2022] GET /identity/v3/services/compute => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:23:12.794726 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7fd8e2-4c79-4a77-a095-b910cede6d0d None None] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:23:12.853136 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:23:12.916050 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7fd8e2-4c79-4a77-a095-b910cede6d0d None None] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:23:12.956916 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d08940-d0a8-4bf8-96dd-836fd1510bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:23:12.957713 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d08940-d0a8-4bf8-96dd-836fd1510bf3 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:23:12.958142 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d08940-d0a8-4bf8-96dd-836fd1510bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:23:12.958568 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d08940-d0a8-4bf8-96dd-836fd1510bf3 None admin] PATH_INFO: `/v3/services` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:23:12.959636 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d08940-d0a8-4bf8-96dd-836fd1510bf3 None admin] RBAC: Adding query filter params (name=compute) {{(pid=87210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:23:12.960123 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d08940-d0a8-4bf8-96dd-836fd1510bf3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:23:12.962403 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d08940-d0a8-4bf8-96dd-836fd1510bf3 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:23:12.970447 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 398/819] 10.222.0.66 () {56 vars in 1112 bytes} [Mon Jul 25 21:23:12 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:23:12.976604 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db037794-c48b-4d7b-8736-da6e81a9216f None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:23:13.085157 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db037794-c48b-4d7b-8736-da6e81a9216f None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:23:13.122656 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d7e578-ac94-42a6-a058-4380bf578569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:23:13.123275 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d7e578-ac94-42a6-a058-4380bf578569 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:23:13.123551 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d7e578-ac94-42a6-a058-4380bf578569 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:23:13.123820 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d7e578-ac94-42a6-a058-4380bf578569 None admin] PATH_INFO: `/v3/services` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:23:13.124480 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d7e578-ac94-42a6-a058-4380bf578569 None admin] RBAC: Adding query filter params (type=compute) {{(pid=87209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:23:13.124777 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d7e578-ac94-42a6-a058-4380bf578569 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:23:13.126205 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d7e578-ac94-42a6-a058-4380bf578569 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:23:13.127606 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:23:13.131900 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 422/820] 10.222.0.66 () {56 vars in 1112 bytes} [Mon Jul 25 21:23:12 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:23:13.137956 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d08940-d0a8-4bf8-96dd-836fd1510bf3 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:23:13.241501 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d08940-d0a8-4bf8-96dd-836fd1510bf3 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:23:13.254980 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:23:13.277373 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e20eca-88d1-4fc9-802a-ed4e87375318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:23:13.277989 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e20eca-88d1-4fc9-802a-ed4e87375318 None admin] REQUEST_METHOD: `POST` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:23:13.278270 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e20eca-88d1-4fc9-802a-ed4e87375318 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:23:13.278536 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e20eca-88d1-4fc9-802a-ed4e87375318 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:23:13.279242 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e20eca-88d1-4fc9-802a-ed4e87375318 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:23:13.280617 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e20eca-88d1-4fc9-802a-ed4e87375318 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:23:13.303517 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 399/821] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Jul 25 21:23:13 2022] POST /identity/v3/endpoints => generated 334 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 21:23:23.133051 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=1 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:23:23.299382 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=15,keystone:INSERT=1 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:15.365192 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04e88b3-4987-4436-85ac-d4329587a29d None None] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:15.365840 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04e88b3-4987-4436-85ac-d4329587a29d None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:15.365941 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04e88b3-4987-4436-85ac-d4329587a29d None None] PATH_INFO: `/` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:15.369124 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 423/822] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:24:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:24:15.373320 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a199f6f-997c-4489-86c3-7726a653311e None None] REQUEST_METHOD: `POST` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:15.373793 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a199f6f-997c-4489-86c3-7726a653311e None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:15.373879 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a199f6f-997c-4489-86c3-7726a653311e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:15.394770 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.auth.core [None req-9a199f6f-997c-4489-86c3-7726a653311e None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:24:15.396228 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.fernet_utils [None req-9a199f6f-997c-4489-86c3-7726a653311e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:24:15.495361 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 400/823] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:24:15 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 21:24:15.521034 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04e88b3-4987-4436-85ac-d4329587a29d None None] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:15.644565 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04e88b3-4987-4436-85ac-d4329587a29d None None] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:15.683767 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a1b7db-a95f-43df-82c2-cf3780dfcb46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:15.684440 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a1b7db-a95f-43df-82c2-cf3780dfcb46 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:15.684734 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a1b7db-a95f-43df-82c2-cf3780dfcb46 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:15.685040 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a1b7db-a95f-43df-82c2-cf3780dfcb46 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:15.696493 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a1b7db-a95f-43df-82c2-cf3780dfcb46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:15.698073 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a1b7db-a95f-43df-82c2-cf3780dfcb46 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:15.713503 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application [None req-c4a1b7db-a95f-43df-82c2-cf3780dfcb46 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:24:15.713503 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:24:15.713503 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:24:15.713503 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:24:15.713503 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:24:15.713503 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:24:15.713503 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:24:15.713503 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:24:15.713503 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:24:15.713503 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:24:15.713503 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:24:15.713503 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:24:15.713503 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:24:15.713503 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:24:15.713503 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:24:15.715065 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:24:15.715065 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:24:15.715065 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:24:15.715065 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:24:15.715065 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:24:15.715065 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:24:15.715065 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:24:15.715065 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:24:15.715065 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application with Lock( Jul 25 21:24:15.715065 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:24:15.715065 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:24:15.715065 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:24:15.715065 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:24:15.715065 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:24:15.715065 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:24:15.715065 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:24:15.715065 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:24:15.716195 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:24:15.716195 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:24:15.716195 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:24:15.716195 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Jul 25 21:24:15.716195 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 424/824] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 25 21:24:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:24:15.721296 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a199f6f-997c-4489-86c3-7726a653311e None None] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:15.845771 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a199f6f-997c-4489-86c3-7726a653311e None None] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:15.879736 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:15.891289 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58457e0e-caa5-404c-9e00-c5184d2973c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:15.891931 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58457e0e-caa5-404c-9e00-c5184d2973c6 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:15.892210 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58457e0e-caa5-404c-9e00-c5184d2973c6 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:15.892476 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58457e0e-caa5-404c-9e00-c5184d2973c6 None admin] PATH_INFO: `/v3/domains` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:15.893224 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58457e0e-caa5-404c-9e00-c5184d2973c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:24:15.893533 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58457e0e-caa5-404c-9e00-c5184d2973c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:15.894993 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58457e0e-caa5-404c-9e00-c5184d2973c6 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:15.908342 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 401/825] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Jul 25 21:24:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:24:15.916921 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a1b7db-a95f-43df-82c2-cf3780dfcb46 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:15.983886 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:16.042422 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a1b7db-a95f-43df-82c2-cf3780dfcb46 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:16.093797 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0bc3d8-89df-4cd4-bbda-63d11a58fe96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:16.094573 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0bc3d8-89df-4cd4-bbda-63d11a58fe96 None admin] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:16.094909 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0bc3d8-89df-4cd4-bbda-63d11a58fe96 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:16.095234 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0bc3d8-89df-4cd4-bbda-63d11a58fe96 None admin] PATH_INFO: `/v3/users` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:16.095932 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0bc3d8-89df-4cd4-bbda-63d11a58fe96 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:16.097435 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0bc3d8-89df-4cd4-bbda-63d11a58fe96 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:16.122435 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 425/826] 10.222.0.66 () {60 vars in 1132 bytes} [Mon Jul 25 21:24:15 2022] POST /identity/v3/users => generated 251 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 21:24:18.644448 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076eeb86-d6f3-49ec-a311-6fa4770121e8 None None] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:18.645028 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076eeb86-d6f3-49ec-a311-6fa4770121e8 None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:18.645028 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076eeb86-d6f3-49ec-a311-6fa4770121e8 None None] PATH_INFO: `/` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:18.646883 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 402/827] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:24:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:24:18.653417 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30b6377-5d01-4858-934e-1455390af023 None None] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:18.653874 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30b6377-5d01-4858-934e-1455390af023 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:18.653976 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30b6377-5d01-4858-934e-1455390af023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:18.674226 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.auth.core [None req-e30b6377-5d01-4858-934e-1455390af023 None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:24:18.675461 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-e30b6377-5d01-4858-934e-1455390af023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:24:18.755053 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 426/828] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:24:18 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 21:24:18.785870 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076eeb86-d6f3-49ec-a311-6fa4770121e8 None None] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:18.901382 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076eeb86-d6f3-49ec-a311-6fa4770121e8 None None] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:18.944896 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa34b12f-9b90-4113-885c-ac4841096b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:18.945615 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa34b12f-9b90-4113-885c-ac4841096b29 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:18.945889 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa34b12f-9b90-4113-885c-ac4841096b29 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:18.946161 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa34b12f-9b90-4113-885c-ac4841096b29 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:18.960540 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa34b12f-9b90-4113-885c-ac4841096b29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:24:18.966211 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application [None req-aa34b12f-9b90-4113-885c-ac4841096b29 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 21:24:18.966211 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:24:18.966211 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:24:18.966211 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:24:18.966211 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:24:18.966211 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:24:18.966211 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:24:18.966211 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:24:18.966211 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:24:18.966211 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:24:18.966211 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:24:18.966211 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:24:18.966211 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:24:18.966211 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:24:18.966211 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:24:18.966211 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:24:18.969204 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:24:18.969204 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:24:18.969204 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:24:18.969204 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:24:18.969204 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:24:18.969204 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:24:18.969204 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:24:18.969204 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:24:18.969204 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:24:18.969204 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:24:18.969204 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:24:18.969204 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application with Lock( Jul 25 21:24:18.969204 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:24:18.969204 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:24:18.969204 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:24:18.969204 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:24:18.970344 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:24:18.970344 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:24:18.970344 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:24:18.970344 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:24:18.970344 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:24:18.970344 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:24:18.970344 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:24:18.970344 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:24:18.970344 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:24:18.970344 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:24:18.970344 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 21:24:18.970344 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Jul 25 21:24:18.970344 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 403/829] 10.222.0.66 () {56 vars in 1102 bytes} [Mon Jul 25 21:24:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:24:18.975609 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30b6377-5d01-4858-934e-1455390af023 None None] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:19.026240 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:19.091633 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30b6377-5d01-4858-934e-1455390af023 None None] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:19.131711 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5b7ffb-fa5f-4d03-98e2-3675e57acb36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:19.132772 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5b7ffb-fa5f-4d03-98e2-3675e57acb36 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:19.133422 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5b7ffb-fa5f-4d03-98e2-3675e57acb36 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:19.134007 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5b7ffb-fa5f-4d03-98e2-3675e57acb36 None admin] PATH_INFO: `/v3/roles` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:19.135819 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5b7ffb-fa5f-4d03-98e2-3675e57acb36 None admin] RBAC: Adding query filter params (name=service) {{(pid=87209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:24:19.136173 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5b7ffb-fa5f-4d03-98e2-3675e57acb36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:19.139264 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5b7ffb-fa5f-4d03-98e2-3675e57acb36 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:19.154505 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 427/830] 10.222.0.66 () {56 vars in 1103 bytes} [Mon Jul 25 21:24:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:19.162257 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa34b12f-9b90-4113-885c-ac4841096b29 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:19.219797 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:19.280093 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa34b12f-9b90-4113-885c-ac4841096b29 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:19.322470 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bdae23-4f4c-4f27-8378-9aee1e537cee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:19.323249 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bdae23-4f4c-4f27-8378-9aee1e537cee None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:19.323587 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bdae23-4f4c-4f27-8378-9aee1e537cee None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:19.323899 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bdae23-4f4c-4f27-8378-9aee1e537cee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:19.335679 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bdae23-4f4c-4f27-8378-9aee1e537cee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:19.337218 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bdae23-4f4c-4f27-8378-9aee1e537cee None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:19.352782 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application [None req-a5bdae23-4f4c-4f27-8378-9aee1e537cee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:24:19.352782 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:24:19.352782 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:24:19.352782 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:24:19.352782 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:24:19.352782 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:24:19.352782 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:24:19.352782 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:24:19.352782 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:24:19.352782 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:24:19.352782 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:24:19.352782 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:24:19.352782 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:24:19.352782 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:24:19.352782 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:24:19.353888 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:24:19.353888 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:24:19.353888 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:24:19.353888 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:24:19.353888 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:24:19.353888 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:24:19.353888 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:24:19.353888 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:24:19.353888 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application with Lock( Jul 25 21:24:19.353888 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:24:19.353888 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:24:19.353888 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:24:19.353888 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:24:19.353888 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:24:19.353888 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:24:19.353888 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:24:19.353888 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:24:19.355272 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:24:19.355272 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:24:19.355272 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:24:19.355272 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Jul 25 21:24:19.355272 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 404/831] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 25 21:24:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:24:19.360283 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5b7ffb-fa5f-4d03-98e2-3675e57acb36 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:19.472978 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:19.477722 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5b7ffb-fa5f-4d03-98e2-3675e57acb36 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:19.520262 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddccc275-d9b7-4abb-ab3d-7155d76a4ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:19.520933 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddccc275-d9b7-4abb-ab3d-7155d76a4ca0 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:19.521251 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddccc275-d9b7-4abb-ab3d-7155d76a4ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:19.521558 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddccc275-d9b7-4abb-ab3d-7155d76a4ca0 None admin] PATH_INFO: `/v3/domains` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:19.522598 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddccc275-d9b7-4abb-ab3d-7155d76a4ca0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:24:19.523302 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddccc275-d9b7-4abb-ab3d-7155d76a4ca0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:19.525001 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddccc275-d9b7-4abb-ab3d-7155d76a4ca0 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:19.539598 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 428/832] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Jul 25 21:24:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:19.546097 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bdae23-4f4c-4f27-8378-9aee1e537cee None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:19.670343 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:19.675933 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bdae23-4f4c-4f27-8378-9aee1e537cee None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:19.723797 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de61e411-f3c6-495d-891d-5b984a7e8c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:19.724378 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de61e411-f3c6-495d-891d-5b984a7e8c91 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:19.724655 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de61e411-f3c6-495d-891d-5b984a7e8c91 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:19.724923 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de61e411-f3c6-495d-891d-5b984a7e8c91 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:19.734594 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de61e411-f3c6-495d-891d-5b984a7e8c91 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:19.736167 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de61e411-f3c6-495d-891d-5b984a7e8c91 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:19.748018 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application [None req-de61e411-f3c6-495d-891d-5b984a7e8c91 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 25 21:24:19.748018 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:24:19.748018 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:24:19.748018 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:24:19.748018 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:24:19.748018 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:24:19.748018 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:24:19.748018 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:24:19.748018 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:24:19.748018 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:24:19.748018 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:24:19.748018 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:24:19.748018 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 21:24:19.748018 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 21:24:19.748018 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 21:24:19.748018 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 21:24:19.750004 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:24:19.750004 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:24:19.750004 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 21:24:19.750004 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:24:19.750004 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 21:24:19.750004 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:24:19.750004 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:24:19.750004 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:24:19.750004 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:24:19.750004 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:24:19.750004 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:24:19.750004 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application with Lock( Jul 25 21:24:19.750004 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:24:19.750004 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:24:19.750004 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:24:19.750004 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:24:19.750004 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:24:19.750004 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:24:19.750998 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:24:19.750998 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:24:19.750998 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 21:24:19.750998 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 21:24:19.750998 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 21:24:19.750998 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 21:24:19.750998 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 21:24:19.750998 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 21:24:19.750998 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 25 21:24:19.750998 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Jul 25 21:24:19.750998 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 405/833] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 25 21:24:19 2022] GET /identity/v3/users/placement => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:24:19.755640 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddccc275-d9b7-4abb-ab3d-7155d76a4ca0 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:19.877578 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddccc275-d9b7-4abb-ab3d-7155d76a4ca0 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:19.917178 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652d92dd-c4f3-4608-9756-188e2c64915a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:19.917936 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652d92dd-c4f3-4608-9756-188e2c64915a None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:19.918217 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652d92dd-c4f3-4608-9756-188e2c64915a None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:19.918509 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652d92dd-c4f3-4608-9756-188e2c64915a None admin] PATH_INFO: `/v3/users` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:19.919331 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652d92dd-c4f3-4608-9756-188e2c64915a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:24:19.919633 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652d92dd-c4f3-4608-9756-188e2c64915a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:19.921146 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652d92dd-c4f3-4608-9756-188e2c64915a None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:19.948269 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 429/834] 10.222.0.66 () {56 vars in 1143 bytes} [Mon Jul 25 21:24:19 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:19.949697 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de61e411-f3c6-495d-891d-5b984a7e8c91 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:20.077506 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de61e411-f3c6-495d-891d-5b984a7e8c91 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:20.114925 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96195ff5-59c5-4e8c-936e-a178c645e8be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:20.115914 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96195ff5-59c5-4e8c-936e-a178c645e8be None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:20.116237 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96195ff5-59c5-4e8c-936e-a178c645e8be None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:20.116519 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96195ff5-59c5-4e8c-936e-a178c645e8be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:20.145906 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:20.189970 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96195ff5-59c5-4e8c-936e-a178c645e8be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:20.191593 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96195ff5-59c5-4e8c-936e-a178c645e8be None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:20.300056 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 406/835] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Jul 25 21:24:19 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 21:24:20.306284 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652d92dd-c4f3-4608-9756-188e2c64915a None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:20.327259 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:20.417389 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652d92dd-c4f3-4608-9756-188e2c64915a None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:20.454964 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeb5098-6251-4252-84e7-e28a54b3a64c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:20.455727 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeb5098-6251-4252-84e7-e28a54b3a64c None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:20.455983 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeb5098-6251-4252-84e7-e28a54b3a64c None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:20.456254 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeb5098-6251-4252-84e7-e28a54b3a64c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:20.467762 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfeb5098-6251-4252-84e7-e28a54b3a64c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:20.469253 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfeb5098-6251-4252-84e7-e28a54b3a64c None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:20.484851 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application [None req-cfeb5098-6251-4252-84e7-e28a54b3a64c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:24:20.484851 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:24:20.484851 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:24:20.484851 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:24:20.484851 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:24:20.484851 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:24:20.484851 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:24:20.484851 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:24:20.484851 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:24:20.484851 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:24:20.484851 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:24:20.484851 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:24:20.484851 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:24:20.484851 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:24:20.484851 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:24:20.485970 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:24:20.485970 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:24:20.485970 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:24:20.485970 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:24:20.485970 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:24:20.485970 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:24:20.485970 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:24:20.485970 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:24:20.485970 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application with Lock( Jul 25 21:24:20.485970 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:24:20.485970 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:24:20.485970 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:24:20.485970 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:24:20.485970 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:24:20.485970 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:24:20.485970 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:24:20.485970 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:24:20.487208 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:24:20.487208 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:24:20.487208 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:24:20.487208 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Jul 25 21:24:20.487208 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 430/836] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 25 21:24:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 21:24:20.492721 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96195ff5-59c5-4e8c-936e-a178c645e8be None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:20.558218 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:20.604184 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96195ff5-59c5-4e8c-936e-a178c645e8be None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:20.640117 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0565cfe9-b0b3-4d1c-8e66-17ff3124bbb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:20.640767 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0565cfe9-b0b3-4d1c-8e66-17ff3124bbb2 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:20.641043 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0565cfe9-b0b3-4d1c-8e66-17ff3124bbb2 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:20.641343 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0565cfe9-b0b3-4d1c-8e66-17ff3124bbb2 None admin] PATH_INFO: `/v3/domains` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:20.642028 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0565cfe9-b0b3-4d1c-8e66-17ff3124bbb2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:24:20.642328 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0565cfe9-b0b3-4d1c-8e66-17ff3124bbb2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:20.643706 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0565cfe9-b0b3-4d1c-8e66-17ff3124bbb2 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:20.656392 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 407/837] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Jul 25 21:24:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:20.662416 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeb5098-6251-4252-84e7-e28a54b3a64c None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:20.733705 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:20.768513 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeb5098-6251-4252-84e7-e28a54b3a64c None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:20.802771 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51ebb5b-2ace-4ffb-973b-a2858acb0282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:20.803480 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51ebb5b-2ace-4ffb-973b-a2858acb0282 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:20.803758 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51ebb5b-2ace-4ffb-973b-a2858acb0282 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:20.804030 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51ebb5b-2ace-4ffb-973b-a2858acb0282 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:20.810989 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51ebb5b-2ace-4ffb-973b-a2858acb0282 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:20.813748 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51ebb5b-2ace-4ffb-973b-a2858acb0282 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:20.826373 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application [None req-b51ebb5b-2ace-4ffb-973b-a2858acb0282 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:24:20.826373 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:24:20.826373 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:24:20.826373 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:24:20.826373 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:24:20.826373 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:24:20.826373 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:24:20.826373 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:24:20.826373 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:24:20.826373 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:24:20.826373 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:24:20.826373 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:24:20.826373 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 21:24:20.826373 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 21:24:20.826373 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 21:24:20.827481 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 21:24:20.827481 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:24:20.827481 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:24:20.827481 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:24:20.827481 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:24:20.827481 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:24:20.827481 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:24:20.827481 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:24:20.827481 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application with Lock( Jul 25 21:24:20.827481 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:24:20.827481 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:24:20.827481 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:24:20.827481 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:24:20.827481 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:24:20.827481 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:24:20.827481 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:24:20.827481 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:24:20.828371 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 21:24:20.828371 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 21:24:20.828371 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 21:24:20.828371 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 21:24:20.828371 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 21:24:20.828371 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 21:24:20.828371 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:24:20.828371 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Jul 25 21:24:20.828371 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 431/838] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Jul 25 21:24:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:24:20.833742 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0565cfe9-b0b3-4d1c-8e66-17ff3124bbb2 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:20.946588 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0565cfe9-b0b3-4d1c-8e66-17ff3124bbb2 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:20.968332 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:20.986966 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f04902-a40a-40f5-bc2f-51d4ab3b8917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:20.987523 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f04902-a40a-40f5-bc2f-51d4ab3b8917 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:20.987799 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f04902-a40a-40f5-bc2f-51d4ab3b8917 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:20.988069 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f04902-a40a-40f5-bc2f-51d4ab3b8917 None admin] PATH_INFO: `/v3/projects` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:20.988806 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f04902-a40a-40f5-bc2f-51d4ab3b8917 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:24:20.989134 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f04902-a40a-40f5-bc2f-51d4ab3b8917 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:20.990569 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f04902-a40a-40f5-bc2f-51d4ab3b8917 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:21.003920 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 408/839] 10.222.0.66 () {56 vars in 1148 bytes} [Mon Jul 25 21:24:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:24:21.010905 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51ebb5b-2ace-4ffb-973b-a2858acb0282 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:21.120257 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51ebb5b-2ace-4ffb-973b-a2858acb0282 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:21.149523 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:21.156345 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f44b2b-1fbe-443d-9e12-d3c431e82411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:21.156975 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f44b2b-1fbe-443d-9e12-d3c431e82411 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:21.157356 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f44b2b-1fbe-443d-9e12-d3c431e82411 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:21.157639 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f44b2b-1fbe-443d-9e12-d3c431e82411 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:21.158427 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f44b2b-1fbe-443d-9e12-d3c431e82411 None admin] RBAC: Adding query filter params (role.id=a3f3fbd04ac04f888e9d384179040765, scope.project.id=7e36d923af474a07adb12209580f12e1, user.id=3e0e5ab2acc3425c9d820f2027f5652b) {{(pid=87209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:24:21.158716 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f44b2b-1fbe-443d-9e12-d3c431e82411 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:21.160167 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f44b2b-1fbe-443d-9e12-d3c431e82411 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:21.166489 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 432/840] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Jul 25 21:24:21 2022] GET /identity/v3/role_assignments?user.id=3e0e5ab2acc3425c9d820f2027f5652b&scope.project.id=7e36d923af474a07adb12209580f12e1&role.id=a3f3fbd04ac04f888e9d384179040765 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:23.488915 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c850b1a-4d00-407c-9234-64692d8fe9da None None] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:23.489565 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c850b1a-4d00-407c-9234-64692d8fe9da None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:23.489670 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c850b1a-4d00-407c-9234-64692d8fe9da None None] PATH_INFO: `/` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:23.493116 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 409/841] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:24:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:24:23.498054 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9e33f2-d843-4294-9f47-6bfc40f8041c None None] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:23.498537 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9e33f2-d843-4294-9f47-6bfc40f8041c None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:23.498687 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9e33f2-d843-4294-9f47-6bfc40f8041c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:23.519240 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.auth.core [None req-7c9e33f2-d843-4294-9f47-6bfc40f8041c None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:24:23.520452 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-7c9e33f2-d843-4294-9f47-6bfc40f8041c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:24:23.600009 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 433/842] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:24:23 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 21:24:23.625198 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c850b1a-4d00-407c-9234-64692d8fe9da None None] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:23.730619 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c850b1a-4d00-407c-9234-64692d8fe9da None None] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:23.767867 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34b9c7d-11d1-420f-9dcb-4e19b42363bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:23.768490 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34b9c7d-11d1-420f-9dcb-4e19b42363bc None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:23.768785 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34b9c7d-11d1-420f-9dcb-4e19b42363bc None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:23.769075 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34b9c7d-11d1-420f-9dcb-4e19b42363bc None admin] PATH_INFO: `/v3/roles/service` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:23.780331 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34b9c7d-11d1-420f-9dcb-4e19b42363bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:24:23.785328 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application [None req-e34b9c7d-11d1-420f-9dcb-4e19b42363bc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 21:24:23.785328 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:24:23.785328 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:24:23.785328 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:24:23.785328 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:24:23.785328 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:24:23.785328 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:24:23.785328 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:24:23.785328 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:24:23.785328 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:24:23.785328 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:24:23.785328 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:24:23.785328 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:24:23.785328 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:24:23.785328 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:24:23.785328 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:24:23.786432 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:24:23.786432 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:24:23.786432 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:24:23.786432 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:24:23.786432 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:24:23.786432 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:24:23.786432 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:24:23.786432 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:24:23.786432 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:24:23.786432 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:24:23.786432 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:24:23.786432 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application with Lock( Jul 25 21:24:23.786432 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:24:23.786432 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:24:23.786432 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:24:23.786432 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:24:23.787395 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:24:23.787395 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:24:23.787395 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:24:23.787395 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:24:23.787395 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:24:23.787395 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:24:23.787395 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:24:23.787395 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:24:23.787395 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:24:23.787395 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:24:23.787395 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 21:24:23.787395 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Jul 25 21:24:23.789454 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 410/843] 10.222.0.66 () {56 vars in 1102 bytes} [Mon Jul 25 21:24:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:24:23.793672 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9e33f2-d843-4294-9f47-6bfc40f8041c None None] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:23.901137 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9e33f2-d843-4294-9f47-6bfc40f8041c None None] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:23.926589 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:23.940876 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72797836-f4e8-40c3-ba5b-f7f5ede0872c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:23.941597 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72797836-f4e8-40c3-ba5b-f7f5ede0872c None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:23.941879 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72797836-f4e8-40c3-ba5b-f7f5ede0872c None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:23.942153 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72797836-f4e8-40c3-ba5b-f7f5ede0872c None admin] PATH_INFO: `/v3/roles` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:23.942884 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72797836-f4e8-40c3-ba5b-f7f5ede0872c None admin] RBAC: Adding query filter params (name=service) {{(pid=87209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:24:23.943184 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72797836-f4e8-40c3-ba5b-f7f5ede0872c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:23.944758 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72797836-f4e8-40c3-ba5b-f7f5ede0872c None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:23.953820 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 434/844] 10.222.0.66 () {56 vars in 1103 bytes} [Mon Jul 25 21:24:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:23.960376 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34b9c7d-11d1-420f-9dcb-4e19b42363bc None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:24.009502 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:24.081133 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34b9c7d-11d1-420f-9dcb-4e19b42363bc None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:24.118997 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080e1b8f-f267-4815-a9e7-b679fafa0bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:24.119939 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080e1b8f-f267-4815-a9e7-b679fafa0bab None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:24.120351 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080e1b8f-f267-4815-a9e7-b679fafa0bab None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:24.120819 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080e1b8f-f267-4815-a9e7-b679fafa0bab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:24.134467 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080e1b8f-f267-4815-a9e7-b679fafa0bab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:24.135966 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080e1b8f-f267-4815-a9e7-b679fafa0bab None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:24.150456 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application [None req-080e1b8f-f267-4815-a9e7-b679fafa0bab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:24:24.150456 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:24:24.150456 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:24:24.150456 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:24:24.150456 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:24:24.150456 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:24:24.150456 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:24:24.150456 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:24:24.150456 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:24:24.150456 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:24:24.150456 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:24:24.150456 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:24:24.150456 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:24:24.150456 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:24:24.150456 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:24:24.151424 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:24:24.151424 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:24:24.151424 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:24:24.151424 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:24:24.151424 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:24:24.151424 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:24:24.151424 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:24:24.151424 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:24:24.151424 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application with Lock( Jul 25 21:24:24.151424 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:24:24.151424 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:24:24.151424 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:24:24.151424 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:24:24.151424 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:24:24.151424 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:24:24.151424 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:24:24.151424 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:24:24.152447 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:24:24.152447 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:24:24.152447 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:24:24.152447 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Jul 25 21:24:24.156566 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 411/845] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 25 21:24:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 21:24:24.157831 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72797836-f4e8-40c3-ba5b-f7f5ede0872c None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:24.273888 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72797836-f4e8-40c3-ba5b-f7f5ede0872c None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:24.312639 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a454f0-e6fc-4fc0-b64b-37c79e47b3e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:24.313496 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a454f0-e6fc-4fc0-b64b-37c79e47b3e3 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:24.313803 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a454f0-e6fc-4fc0-b64b-37c79e47b3e3 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:24.314114 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a454f0-e6fc-4fc0-b64b-37c79e47b3e3 None admin] PATH_INFO: `/v3/domains` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:24.314969 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a454f0-e6fc-4fc0-b64b-37c79e47b3e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:24:24.315304 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a454f0-e6fc-4fc0-b64b-37c79e47b3e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:24.317010 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a454f0-e6fc-4fc0-b64b-37c79e47b3e3 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:24.332550 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 435/846] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Jul 25 21:24:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:24:24.338840 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080e1b8f-f267-4815-a9e7-b679fafa0bab None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:24.439489 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:24.450089 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080e1b8f-f267-4815-a9e7-b679fafa0bab None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:24.485446 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302abe28-e84c-4c5b-847e-2bcf31747863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:24.486107 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302abe28-e84c-4c5b-847e-2bcf31747863 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:24.486430 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302abe28-e84c-4c5b-847e-2bcf31747863 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:24.486706 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302abe28-e84c-4c5b-847e-2bcf31747863 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:24.496913 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302abe28-e84c-4c5b-847e-2bcf31747863 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:24.498931 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302abe28-e84c-4c5b-847e-2bcf31747863 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:24.513471 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application [None req-302abe28-e84c-4c5b-847e-2bcf31747863 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 25 21:24:24.513471 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:24:24.513471 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:24:24.513471 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:24:24.513471 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:24:24.513471 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:24:24.513471 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:24:24.513471 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:24:24.513471 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:24:24.513471 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:24:24.513471 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:24:24.513471 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:24:24.513471 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 21:24:24.513471 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 21:24:24.513471 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 21:24:24.513471 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 21:24:24.514665 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:24:24.514665 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:24:24.514665 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 21:24:24.514665 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:24:24.514665 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 21:24:24.514665 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:24:24.514665 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:24:24.514665 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:24:24.514665 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:24:24.514665 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:24:24.514665 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:24:24.514665 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application with Lock( Jul 25 21:24:24.514665 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:24:24.514665 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:24:24.514665 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:24:24.514665 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:24:24.514665 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:24:24.514665 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:24:24.515685 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:24:24.515685 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:24:24.515685 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 21:24:24.515685 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 21:24:24.515685 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 21:24:24.515685 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 21:24:24.515685 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 21:24:24.515685 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 21:24:24.515685 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 25 21:24:24.515685 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Jul 25 21:24:24.515685 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 412/847] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 25 21:24:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 21:24:24.521096 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a454f0-e6fc-4fc0-b64b-37c79e47b3e3 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:24.582013 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:24.652108 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a454f0-e6fc-4fc0-b64b-37c79e47b3e3 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:24.689704 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79a3a52-0930-430d-a1fd-5e7a49eb3c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:24.690335 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79a3a52-0930-430d-a1fd-5e7a49eb3c9e None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:24.690614 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79a3a52-0930-430d-a1fd-5e7a49eb3c9e None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:24.690886 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79a3a52-0930-430d-a1fd-5e7a49eb3c9e None admin] PATH_INFO: `/v3/users` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:24.691674 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79a3a52-0930-430d-a1fd-5e7a49eb3c9e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:24:24.691979 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79a3a52-0930-430d-a1fd-5e7a49eb3c9e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:24.693465 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79a3a52-0930-430d-a1fd-5e7a49eb3c9e None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:24.714480 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 436/848] 10.222.0.66 () {56 vars in 1143 bytes} [Mon Jul 25 21:24:24 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:24.720432 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302abe28-e84c-4c5b-847e-2bcf31747863 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:24.828185 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302abe28-e84c-4c5b-847e-2bcf31747863 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:24.870941 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eb01c3-9ae0-45c8-9ec0-61404bcbc0ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:24.871630 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eb01c3-9ae0-45c8-9ec0-61404bcbc0ae None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:24.871986 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eb01c3-9ae0-45c8-9ec0-61404bcbc0ae None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:24.872263 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eb01c3-9ae0-45c8-9ec0-61404bcbc0ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:24.884713 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eb01c3-9ae0-45c8-9ec0-61404bcbc0ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:24.886394 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eb01c3-9ae0-45c8-9ec0-61404bcbc0ae None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:24.903695 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application [None req-02eb01c3-9ae0-45c8-9ec0-61404bcbc0ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:24:24.903695 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:24:24.903695 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:24:24.903695 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:24:24.903695 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:24:24.903695 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:24:24.903695 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:24:24.903695 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:24:24.903695 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:24:24.903695 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:24:24.903695 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:24:24.903695 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:24:24.903695 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:24:24.903695 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:24:24.903695 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:24:24.904809 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:24:24.904809 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:24:24.904809 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:24:24.904809 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:24:24.904809 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:24:24.904809 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:24:24.904809 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:24:24.904809 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:24:24.904809 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application with Lock( Jul 25 21:24:24.904809 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:24:24.904809 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:24:24.904809 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:24:24.904809 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:24:24.904809 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:24:24.904809 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:24:24.904809 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:24:24.904809 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:24:24.905922 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:24:24.905922 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:24:24.905922 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:24:24.905922 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Jul 25 21:24:24.905922 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 413/849] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 25 21:24:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:24:24.911443 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79a3a52-0930-430d-a1fd-5e7a49eb3c9e None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:25.028297 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79a3a52-0930-430d-a1fd-5e7a49eb3c9e None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:25.030872 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:25.071102 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38c777f-8d8f-4f9f-9b2d-ebc4a3bb04b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:25.071760 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38c777f-8d8f-4f9f-9b2d-ebc4a3bb04b1 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:25.072039 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38c777f-8d8f-4f9f-9b2d-ebc4a3bb04b1 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:25.072308 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38c777f-8d8f-4f9f-9b2d-ebc4a3bb04b1 None admin] PATH_INFO: `/v3/domains` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:25.072997 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38c777f-8d8f-4f9f-9b2d-ebc4a3bb04b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:24:25.073333 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38c777f-8d8f-4f9f-9b2d-ebc4a3bb04b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:25.074737 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38c777f-8d8f-4f9f-9b2d-ebc4a3bb04b1 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:25.087418 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 437/850] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Jul 25 21:24:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:25.093487 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eb01c3-9ae0-45c8-9ec0-61404bcbc0ae None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:25.096522 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:25.204259 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eb01c3-9ae0-45c8-9ec0-61404bcbc0ae None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:25.247085 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c14c6a3-1028-4cc2-9308-6fb26c0933fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:25.247777 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c14c6a3-1028-4cc2-9308-6fb26c0933fc None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:25.248069 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c14c6a3-1028-4cc2-9308-6fb26c0933fc None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:25.248369 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c14c6a3-1028-4cc2-9308-6fb26c0933fc None admin] PATH_INFO: `/v3/projects/service` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:25.258806 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c14c6a3-1028-4cc2-9308-6fb26c0933fc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:25.260323 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c14c6a3-1028-4cc2-9308-6fb26c0933fc None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:25.272250 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application [None req-3c14c6a3-1028-4cc2-9308-6fb26c0933fc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:24:25.272250 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:24:25.272250 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:24:25.272250 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:24:25.272250 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:24:25.272250 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:24:25.272250 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:24:25.272250 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:24:25.272250 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:24:25.272250 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:24:25.272250 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:24:25.272250 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:24:25.272250 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 21:24:25.272250 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 21:24:25.272250 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 21:24:25.273499 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 21:24:25.273499 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:24:25.273499 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:24:25.273499 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:24:25.273499 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:24:25.273499 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:24:25.273499 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:24:25.273499 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:24:25.273499 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application with Lock( Jul 25 21:24:25.273499 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:24:25.273499 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:24:25.273499 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:24:25.273499 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:24:25.273499 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:24:25.273499 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:24:25.273499 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:24:25.273499 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:24:25.274571 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 21:24:25.274571 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 21:24:25.274571 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 21:24:25.274571 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 21:24:25.274571 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 21:24:25.274571 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 21:24:25.274571 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:24:25.274571 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Jul 25 21:24:25.274571 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 414/851] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Jul 25 21:24:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 21:24:25.279832 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38c777f-8d8f-4f9f-9b2d-ebc4a3bb04b1 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:25.395403 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38c777f-8d8f-4f9f-9b2d-ebc4a3bb04b1 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:25.433320 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4af0b1-f6a8-44c8-9ae7-1db9516b85a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:25.433955 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4af0b1-f6a8-44c8-9ae7-1db9516b85a2 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:25.434237 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4af0b1-f6a8-44c8-9ae7-1db9516b85a2 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:25.434513 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4af0b1-f6a8-44c8-9ae7-1db9516b85a2 None admin] PATH_INFO: `/v3/projects` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:25.435288 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4af0b1-f6a8-44c8-9ae7-1db9516b85a2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:24:25.435577 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4af0b1-f6a8-44c8-9ae7-1db9516b85a2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:25.437015 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4af0b1-f6a8-44c8-9ae7-1db9516b85a2 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:25.451265 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 438/852] 10.222.0.66 () {56 vars in 1148 bytes} [Mon Jul 25 21:24:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:25.457373 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c14c6a3-1028-4cc2-9308-6fb26c0933fc None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:25.523047 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:25.566686 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c14c6a3-1028-4cc2-9308-6fb26c0933fc None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:25.604836 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eb27f0-acb6-4b12-afbb-b97e865a9dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:25.605604 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eb27f0-acb6-4b12-afbb-b97e865a9dbd None admin] REQUEST_METHOD: `PUT` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:25.605848 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eb27f0-acb6-4b12-afbb-b97e865a9dbd None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:25.606210 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eb27f0-acb6-4b12-afbb-b97e865a9dbd None admin] PATH_INFO: `/v3/projects/7e36d923af474a07adb12209580f12e1/users/3e0e5ab2acc3425c9d820f2027f5652b/roles/a3f3fbd04ac04f888e9d384179040765` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:25.623592 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19eb27f0-acb6-4b12-afbb-b97e865a9dbd None admin] RBAC: Authorizing `identity:create_grant(project_id=7e36d923af474a07adb12209580f12e1, user_id=3e0e5ab2acc3425c9d820f2027f5652b, role_id=a3f3fbd04ac04f888e9d384179040765)` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:25.625092 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19eb27f0-acb6-4b12-afbb-b97e865a9dbd None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:25.641936 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 415/853] 10.222.0.66 () {58 vars in 1439 bytes} [Mon Jul 25 21:24:25 2022] PUT /identity/v3/projects/7e36d923af474a07adb12209580f12e1/users/3e0e5ab2acc3425c9d820f2027f5652b/roles/a3f3fbd04ac04f888e9d384179040765 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 21:24:27.953436 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93a04e3-c157-4735-961f-5ff7a7713b1e None None] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:27.953849 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93a04e3-c157-4735-961f-5ff7a7713b1e None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:27.953977 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93a04e3-c157-4735-961f-5ff7a7713b1e None None] PATH_INFO: `/` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:27.955412 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 439/854] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:24:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:24:27.962101 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440f2311-1450-4909-b1ef-fd335eeb2fa6 None None] REQUEST_METHOD: `POST` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:27.962608 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440f2311-1450-4909-b1ef-fd335eeb2fa6 None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:27.962688 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440f2311-1450-4909-b1ef-fd335eeb2fa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:27.982661 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.auth.core [None req-440f2311-1450-4909-b1ef-fd335eeb2fa6 None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:24:27.984002 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.fernet_utils [None req-440f2311-1450-4909-b1ef-fd335eeb2fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:24:28.058447 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 416/855] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:24:27 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 21:24:28.084004 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93a04e3-c157-4735-961f-5ff7a7713b1e None None] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:28.118091 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:28.212385 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93a04e3-c157-4735-961f-5ff7a7713b1e None None] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:28.251268 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f13a96-6c27-4f88-9e60-e017ccbb884f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:28.251962 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f13a96-6c27-4f88-9e60-e017ccbb884f None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:28.252239 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f13a96-6c27-4f88-9e60-e017ccbb884f None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:28.252508 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f13a96-6c27-4f88-9e60-e017ccbb884f None admin] PATH_INFO: `/v3/roles/service` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:28.263614 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f13a96-6c27-4f88-9e60-e017ccbb884f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:24:28.268725 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application [None req-32f13a96-6c27-4f88-9e60-e017ccbb884f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 21:24:28.268725 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:24:28.268725 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:24:28.268725 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:24:28.268725 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:24:28.268725 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:24:28.268725 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:24:28.268725 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:24:28.268725 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:24:28.268725 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:24:28.268725 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:24:28.268725 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:24:28.268725 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:24:28.268725 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:24:28.268725 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:24:28.268725 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:24:28.270390 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:24:28.270390 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:24:28.270390 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:24:28.270390 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:24:28.270390 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:24:28.270390 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:24:28.270390 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:24:28.270390 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:24:28.270390 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:24:28.270390 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:24:28.270390 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:24:28.270390 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application with Lock( Jul 25 21:24:28.270390 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:24:28.270390 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:24:28.270390 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:24:28.270390 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:24:28.271757 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:24:28.271757 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:24:28.271757 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:24:28.271757 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:24:28.271757 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:24:28.271757 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:24:28.271757 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:24:28.271757 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:24:28.271757 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:24:28.271757 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:24:28.271757 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 21:24:28.271757 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Jul 25 21:24:28.271757 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 440/856] 10.222.0.66 () {56 vars in 1102 bytes} [Mon Jul 25 21:24:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:24:28.278057 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440f2311-1450-4909-b1ef-fd335eeb2fa6 None None] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:28.330570 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:28.396087 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440f2311-1450-4909-b1ef-fd335eeb2fa6 None None] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:28.432929 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592ec379-a5aa-4ce3-82a3-37381132b72e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:28.433601 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592ec379-a5aa-4ce3-82a3-37381132b72e None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:28.433899 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592ec379-a5aa-4ce3-82a3-37381132b72e None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:28.436052 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592ec379-a5aa-4ce3-82a3-37381132b72e None admin] PATH_INFO: `/v3/roles` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:28.436052 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592ec379-a5aa-4ce3-82a3-37381132b72e None admin] RBAC: Adding query filter params (name=service) {{(pid=87210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:24:28.436052 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592ec379-a5aa-4ce3-82a3-37381132b72e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:28.436506 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592ec379-a5aa-4ce3-82a3-37381132b72e None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:28.445635 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 417/857] 10.222.0.66 () {56 vars in 1103 bytes} [Mon Jul 25 21:24:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:28.451546 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f13a96-6c27-4f88-9e60-e017ccbb884f None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:28.545249 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:28.561548 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f13a96-6c27-4f88-9e60-e017ccbb884f None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:28.598413 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aeca0b-b785-4aec-b70b-a32831ac0b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:28.599166 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aeca0b-b785-4aec-b70b-a32831ac0b47 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:28.599477 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aeca0b-b785-4aec-b70b-a32831ac0b47 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:28.599754 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aeca0b-b785-4aec-b70b-a32831ac0b47 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:28.612633 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98aeca0b-b785-4aec-b70b-a32831ac0b47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:28.614309 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98aeca0b-b785-4aec-b70b-a32831ac0b47 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:28.632687 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application [None req-98aeca0b-b785-4aec-b70b-a32831ac0b47 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:24:28.632687 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:24:28.632687 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:24:28.632687 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:24:28.632687 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:24:28.632687 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:24:28.632687 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:24:28.632687 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:24:28.632687 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:24:28.632687 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:24:28.632687 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:24:28.632687 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:24:28.632687 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:24:28.632687 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:24:28.632687 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:24:28.633947 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:24:28.633947 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:24:28.633947 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:24:28.633947 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:24:28.633947 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:24:28.633947 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:24:28.633947 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:24:28.633947 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:24:28.633947 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application with Lock( Jul 25 21:24:28.633947 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:24:28.633947 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:24:28.633947 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:24:28.633947 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:24:28.633947 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:24:28.633947 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:24:28.633947 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:24:28.633947 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:24:28.634888 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:24:28.634888 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:24:28.634888 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:24:28.634888 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Jul 25 21:24:28.634888 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 441/858] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 25 21:24:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:24:28.641898 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592ec379-a5aa-4ce3-82a3-37381132b72e None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:28.750081 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592ec379-a5aa-4ce3-82a3-37381132b72e None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:28.753040 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:28.789634 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73c1f97-af82-4a36-99ff-87a988870633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:28.790251 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73c1f97-af82-4a36-99ff-87a988870633 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:28.790530 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73c1f97-af82-4a36-99ff-87a988870633 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:28.790802 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73c1f97-af82-4a36-99ff-87a988870633 None admin] PATH_INFO: `/v3/domains` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:28.791554 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73c1f97-af82-4a36-99ff-87a988870633 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:24:28.791837 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73c1f97-af82-4a36-99ff-87a988870633 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:28.793217 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73c1f97-af82-4a36-99ff-87a988870633 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:28.805973 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 418/859] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Jul 25 21:24:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:28.811938 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aeca0b-b785-4aec-b70b-a32831ac0b47 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:28.925857 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aeca0b-b785-4aec-b70b-a32831ac0b47 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:28.965238 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2bd091-9169-49f6-bf68-0d070a4fd236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:28.965983 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2bd091-9169-49f6-bf68-0d070a4fd236 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:28.966266 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2bd091-9169-49f6-bf68-0d070a4fd236 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:28.966575 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2bd091-9169-49f6-bf68-0d070a4fd236 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:28.969653 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:28.975775 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2bd091-9169-49f6-bf68-0d070a4fd236 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:28.977992 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2bd091-9169-49f6-bf68-0d070a4fd236 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:28.991863 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application [None req-ef2bd091-9169-49f6-bf68-0d070a4fd236 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 25 21:24:28.991863 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:24:28.991863 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:24:28.991863 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:24:28.991863 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:24:28.991863 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:24:28.991863 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:24:28.991863 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:24:28.991863 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:24:28.991863 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:24:28.991863 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:24:28.991863 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:24:28.991863 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 21:24:28.991863 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 21:24:28.991863 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 21:24:28.991863 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 21:24:28.993061 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:24:28.993061 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:24:28.993061 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 21:24:28.993061 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:24:28.993061 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 21:24:28.993061 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:24:28.993061 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:24:28.993061 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:24:28.993061 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:24:28.993061 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:24:28.993061 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:24:28.993061 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application with Lock( Jul 25 21:24:28.993061 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:24:28.993061 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:24:28.993061 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:24:28.993061 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:24:28.993061 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:24:28.993061 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:24:28.994052 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:24:28.994052 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:24:28.994052 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 21:24:28.994052 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 21:24:28.994052 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 21:24:28.994052 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 21:24:28.994052 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 21:24:28.994052 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 21:24:28.994052 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 25 21:24:28.994052 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Jul 25 21:24:28.994052 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 442/860] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 25 21:24:28 2022] GET /identity/v3/users/placement => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:24:28.999576 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73c1f97-af82-4a36-99ff-87a988870633 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:29.109448 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73c1f97-af82-4a36-99ff-87a988870633 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:29.147646 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c48cbe-7b5c-4975-b24c-b17c581a7bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:29.148528 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c48cbe-7b5c-4975-b24c-b17c581a7bb0 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:29.148828 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c48cbe-7b5c-4975-b24c-b17c581a7bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:29.149195 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c48cbe-7b5c-4975-b24c-b17c581a7bb0 None admin] PATH_INFO: `/v3/users` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:29.150122 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c48cbe-7b5c-4975-b24c-b17c581a7bb0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:24:29.150519 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c48cbe-7b5c-4975-b24c-b17c581a7bb0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:29.152043 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c48cbe-7b5c-4975-b24c-b17c581a7bb0 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:29.170315 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 419/861] 10.222.0.66 () {56 vars in 1143 bytes} [Mon Jul 25 21:24:28 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:29.176762 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2bd091-9169-49f6-bf68-0d070a4fd236 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:29.303223 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2bd091-9169-49f6-bf68-0d070a4fd236 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:29.346918 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470a0a7e-d96e-40d3-bbfe-5abc90773ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:29.347790 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470a0a7e-d96e-40d3-bbfe-5abc90773ecc None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:29.348072 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470a0a7e-d96e-40d3-bbfe-5abc90773ecc None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:29.348340 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470a0a7e-d96e-40d3-bbfe-5abc90773ecc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:29.421916 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:29.430689 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470a0a7e-d96e-40d3-bbfe-5abc90773ecc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:29.432302 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470a0a7e-d96e-40d3-bbfe-5abc90773ecc None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:29.544579 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 443/862] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Jul 25 21:24:29 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 21:24:29.550758 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c48cbe-7b5c-4975-b24c-b17c581a7bb0 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:29.580945 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:29.680068 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c48cbe-7b5c-4975-b24c-b17c581a7bb0 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:29.716179 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fb7cd5-d15b-4aeb-a539-8f12f0b548d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:29.716847 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fb7cd5-d15b-4aeb-a539-8f12f0b548d1 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:29.717143 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fb7cd5-d15b-4aeb-a539-8f12f0b548d1 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:29.717416 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fb7cd5-d15b-4aeb-a539-8f12f0b548d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:29.728146 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fb7cd5-d15b-4aeb-a539-8f12f0b548d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:29.729652 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fb7cd5-d15b-4aeb-a539-8f12f0b548d1 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:29.746791 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application [None req-35fb7cd5-d15b-4aeb-a539-8f12f0b548d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:24:29.746791 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:24:29.746791 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:24:29.746791 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:24:29.746791 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:24:29.746791 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:24:29.746791 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:24:29.746791 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:24:29.746791 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:24:29.746791 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:24:29.746791 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:24:29.746791 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:24:29.746791 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:24:29.746791 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:24:29.746791 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:24:29.747748 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:24:29.747748 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:24:29.747748 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:24:29.747748 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:24:29.747748 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:24:29.747748 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:24:29.747748 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:24:29.747748 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:24:29.747748 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application with Lock( Jul 25 21:24:29.747748 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:24:29.747748 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:24:29.747748 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:24:29.747748 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:24:29.747748 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:24:29.747748 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:24:29.747748 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:24:29.747748 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:24:29.748643 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:24:29.748643 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:24:29.748643 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:24:29.748643 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Jul 25 21:24:29.748643 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 420/863] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 25 21:24:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:24:29.754048 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470a0a7e-d96e-40d3-bbfe-5abc90773ecc None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:29.857817 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:29.864352 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470a0a7e-d96e-40d3-bbfe-5abc90773ecc None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:29.900556 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bfa50f-cfaa-437d-8362-e6fd3d6480c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:29.901220 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bfa50f-cfaa-437d-8362-e6fd3d6480c1 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:29.901500 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bfa50f-cfaa-437d-8362-e6fd3d6480c1 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:29.901774 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bfa50f-cfaa-437d-8362-e6fd3d6480c1 None admin] PATH_INFO: `/v3/domains` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:29.902461 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bfa50f-cfaa-437d-8362-e6fd3d6480c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:24:29.902763 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bfa50f-cfaa-437d-8362-e6fd3d6480c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:29.904157 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bfa50f-cfaa-437d-8362-e6fd3d6480c1 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:29.916546 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 444/864] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Jul 25 21:24:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:24:29.922397 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fb7cd5-d15b-4aeb-a539-8f12f0b548d1 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:30.009459 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:30.039494 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fb7cd5-d15b-4aeb-a539-8f12f0b548d1 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:30.078757 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44cda7f-6860-433b-8d10-50278abb3393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:30.079621 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44cda7f-6860-433b-8d10-50278abb3393 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:30.080020 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44cda7f-6860-433b-8d10-50278abb3393 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:30.080377 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44cda7f-6860-433b-8d10-50278abb3393 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:30.087765 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44cda7f-6860-433b-8d10-50278abb3393 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:30.089263 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44cda7f-6860-433b-8d10-50278abb3393 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:30.102467 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application [None req-f44cda7f-6860-433b-8d10-50278abb3393 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:24:30.102467 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:24:30.102467 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:24:30.102467 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:24:30.102467 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:24:30.102467 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:24:30.102467 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:24:30.102467 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:24:30.102467 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:24:30.102467 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:24:30.102467 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:24:30.102467 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:24:30.102467 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 21:24:30.102467 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 21:24:30.102467 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 21:24:30.103437 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 21:24:30.103437 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:24:30.103437 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:24:30.103437 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:24:30.103437 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:24:30.103437 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:24:30.103437 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:24:30.103437 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:24:30.103437 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application with Lock( Jul 25 21:24:30.103437 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:24:30.103437 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:24:30.103437 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:24:30.103437 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:24:30.103437 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:24:30.103437 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:24:30.103437 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:24:30.103437 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:24:30.104468 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 21:24:30.104468 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 21:24:30.104468 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 21:24:30.104468 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 21:24:30.104468 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 21:24:30.104468 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 21:24:30.104468 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:24:30.104468 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Jul 25 21:24:30.104468 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 421/865] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Jul 25 21:24:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:24:30.110623 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bfa50f-cfaa-437d-8362-e6fd3d6480c1 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:30.225895 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bfa50f-cfaa-437d-8362-e6fd3d6480c1 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:30.265376 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537d580e-2bb4-4f4e-ad04-279cfe58c721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:30.266009 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537d580e-2bb4-4f4e-ad04-279cfe58c721 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:30.266287 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537d580e-2bb4-4f4e-ad04-279cfe58c721 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:30.266556 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537d580e-2bb4-4f4e-ad04-279cfe58c721 None admin] PATH_INFO: `/v3/projects` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:30.267296 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537d580e-2bb4-4f4e-ad04-279cfe58c721 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:24:30.267598 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537d580e-2bb4-4f4e-ad04-279cfe58c721 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:30.269049 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537d580e-2bb4-4f4e-ad04-279cfe58c721 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:30.282648 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 445/866] 10.222.0.66 () {56 vars in 1148 bytes} [Mon Jul 25 21:24:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:30.289511 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44cda7f-6860-433b-8d10-50278abb3393 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:30.395275 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44cda7f-6860-433b-8d10-50278abb3393 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:30.434331 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813fb357-e717-4db9-a5f7-ec5452dbda88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:30.435053 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813fb357-e717-4db9-a5f7-ec5452dbda88 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:30.435350 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813fb357-e717-4db9-a5f7-ec5452dbda88 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:30.435669 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813fb357-e717-4db9-a5f7-ec5452dbda88 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:30.436486 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813fb357-e717-4db9-a5f7-ec5452dbda88 None admin] RBAC: Adding query filter params (role.id=a3f3fbd04ac04f888e9d384179040765, scope.project.id=7e36d923af474a07adb12209580f12e1, user.id=3e0e5ab2acc3425c9d820f2027f5652b) {{(pid=87210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:24:30.436927 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813fb357-e717-4db9-a5f7-ec5452dbda88 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:30.438381 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813fb357-e717-4db9-a5f7-ec5452dbda88 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:30.440334 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:30.445924 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 422/867] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Jul 25 21:24:30 2022] GET /identity/v3/role_assignments?user.id=3e0e5ab2acc3425c9d820f2027f5652b&scope.project.id=7e36d923af474a07adb12209580f12e1&role.id=a3f3fbd04ac04f888e9d384179040765 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:33.021396 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dabd6fd-f4e6-4ecf-8b49-2d57d968ad90 None None] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:33.022188 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dabd6fd-f4e6-4ecf-8b49-2d57d968ad90 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:33.022188 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dabd6fd-f4e6-4ecf-8b49-2d57d968ad90 None None] PATH_INFO: `/` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:33.024027 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 446/868] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:24:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:24:33.031155 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1fb64e-295c-4c66-9ea7-99deffb4fa1e None None] REQUEST_METHOD: `POST` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:33.031742 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1fb64e-295c-4c66-9ea7-99deffb4fa1e None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:33.031930 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1fb64e-295c-4c66-9ea7-99deffb4fa1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:33.057714 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.auth.core [None req-ab1fb64e-295c-4c66-9ea7-99deffb4fa1e None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:24:33.059293 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.fernet_utils [None req-ab1fb64e-295c-4c66-9ea7-99deffb4fa1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:24:33.154070 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 423/869] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:24:33 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 21:24:33.188178 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dabd6fd-f4e6-4ecf-8b49-2d57d968ad90 None None] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:33.212915 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:33.310415 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dabd6fd-f4e6-4ecf-8b49-2d57d968ad90 None None] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:33.350795 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf907ae9-b80a-41ab-929a-3b8dfdc308cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:33.351496 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf907ae9-b80a-41ab-929a-3b8dfdc308cd None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:33.351772 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf907ae9-b80a-41ab-929a-3b8dfdc308cd None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:33.352040 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf907ae9-b80a-41ab-929a-3b8dfdc308cd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:33.363280 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf907ae9-b80a-41ab-929a-3b8dfdc308cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:24:33.368603 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application [None req-bf907ae9-b80a-41ab-929a-3b8dfdc308cd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 21:24:33.368603 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:24:33.368603 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:24:33.368603 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:24:33.368603 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:24:33.368603 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:24:33.368603 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:24:33.368603 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:24:33.368603 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:24:33.368603 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:24:33.368603 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:24:33.368603 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:24:33.368603 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:24:33.368603 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:24:33.368603 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:24:33.368603 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:24:33.369940 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:24:33.369940 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:24:33.369940 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:24:33.369940 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:24:33.369940 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:24:33.369940 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:24:33.369940 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:24:33.369940 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:24:33.369940 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:24:33.369940 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:24:33.369940 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:24:33.369940 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application with Lock( Jul 25 21:24:33.369940 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:24:33.369940 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:24:33.369940 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:24:33.369940 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:24:33.371045 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:24:33.371045 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:24:33.371045 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:24:33.371045 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:24:33.371045 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:24:33.371045 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:24:33.371045 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:24:33.371045 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:24:33.371045 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:24:33.371045 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:24:33.371045 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 21:24:33.371045 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Jul 25 21:24:33.371045 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 447/870] 10.222.0.66 () {56 vars in 1096 bytes} [Mon Jul 25 21:24:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:24:33.376620 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1fb64e-295c-4c66-9ea7-99deffb4fa1e None None] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:33.498313 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1fb64e-295c-4c66-9ea7-99deffb4fa1e None None] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:33.529607 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:33.540564 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c16f24-1a8f-49ae-acc5-80733e78027d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:33.541293 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c16f24-1a8f-49ae-acc5-80733e78027d None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:33.542410 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c16f24-1a8f-49ae-acc5-80733e78027d None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:33.542692 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c16f24-1a8f-49ae-acc5-80733e78027d None admin] PATH_INFO: `/v3/roles` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:33.543529 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c16f24-1a8f-49ae-acc5-80733e78027d None admin] RBAC: Adding query filter params (name=admin) {{(pid=87210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:24:33.543861 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c16f24-1a8f-49ae-acc5-80733e78027d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:33.545365 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c16f24-1a8f-49ae-acc5-80733e78027d None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:33.555607 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 424/871] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Jul 25 21:24:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:33.562383 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf907ae9-b80a-41ab-929a-3b8dfdc308cd None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:33.660882 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:33.688221 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf907ae9-b80a-41ab-929a-3b8dfdc308cd None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:33.727019 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f83d3c-c832-4e80-88c8-dd7cc23b6e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:33.727681 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f83d3c-c832-4e80-88c8-dd7cc23b6e67 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:33.727966 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f83d3c-c832-4e80-88c8-dd7cc23b6e67 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:33.728241 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f83d3c-c832-4e80-88c8-dd7cc23b6e67 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:33.738546 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f83d3c-c832-4e80-88c8-dd7cc23b6e67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:33.739989 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f83d3c-c832-4e80-88c8-dd7cc23b6e67 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:33.760225 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application [None req-f7f83d3c-c832-4e80-88c8-dd7cc23b6e67 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:24:33.760225 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:24:33.760225 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:24:33.760225 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:24:33.760225 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:24:33.760225 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:24:33.760225 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:24:33.760225 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:24:33.760225 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:24:33.760225 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:24:33.760225 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:24:33.760225 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:24:33.760225 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:24:33.760225 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:24:33.760225 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:24:33.761343 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:24:33.761343 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:24:33.761343 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:24:33.761343 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:24:33.761343 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:24:33.761343 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:24:33.761343 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:24:33.761343 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:24:33.761343 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application with Lock( Jul 25 21:24:33.761343 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:24:33.761343 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:24:33.761343 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:24:33.761343 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:24:33.761343 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:24:33.761343 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:24:33.761343 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:24:33.761343 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:24:33.762282 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:24:33.762282 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:24:33.762282 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:24:33.762282 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Jul 25 21:24:33.762282 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 448/872] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 25 21:24:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:24:33.767866 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c16f24-1a8f-49ae-acc5-80733e78027d None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:33.884918 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c16f24-1a8f-49ae-acc5-80733e78027d None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:33.928074 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29056f74-d37e-4c7f-aa46-e5520ae0b7ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:33.929124 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29056f74-d37e-4c7f-aa46-e5520ae0b7ff None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:33.929474 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29056f74-d37e-4c7f-aa46-e5520ae0b7ff None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:33.929947 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29056f74-d37e-4c7f-aa46-e5520ae0b7ff None admin] PATH_INFO: `/v3/domains` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:33.930749 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29056f74-d37e-4c7f-aa46-e5520ae0b7ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=87210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:24:33.931048 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29056f74-d37e-4c7f-aa46-e5520ae0b7ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:33.932816 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29056f74-d37e-4c7f-aa46-e5520ae0b7ff None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:33.950360 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 425/873] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Jul 25 21:24:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:33.956560 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f83d3c-c832-4e80-88c8-dd7cc23b6e67 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:34.070854 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f83d3c-c832-4e80-88c8-dd7cc23b6e67 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:34.103829 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:34.113790 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d634f1-2cb8-4855-a360-77ba6c2c3a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:34.114628 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d634f1-2cb8-4855-a360-77ba6c2c3a4b None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:34.114960 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d634f1-2cb8-4855-a360-77ba6c2c3a4b None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:34.115260 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d634f1-2cb8-4855-a360-77ba6c2c3a4b None admin] PATH_INFO: `/v3/users/placement` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:34.124711 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d634f1-2cb8-4855-a360-77ba6c2c3a4b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:34.126252 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d634f1-2cb8-4855-a360-77ba6c2c3a4b None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:34.141009 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application [None req-b9d634f1-2cb8-4855-a360-77ba6c2c3a4b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 25 21:24:34.141009 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:24:34.141009 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:24:34.141009 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:24:34.141009 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:24:34.141009 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:24:34.141009 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:24:34.141009 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:24:34.141009 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:24:34.141009 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:24:34.141009 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:24:34.141009 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:24:34.141009 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 21:24:34.141009 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 21:24:34.141009 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 21:24:34.141009 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 21:24:34.142062 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:24:34.142062 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:24:34.142062 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 21:24:34.142062 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:24:34.142062 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 21:24:34.142062 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:24:34.142062 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:24:34.142062 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:24:34.142062 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:24:34.142062 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:24:34.142062 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:24:34.142062 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application with Lock( Jul 25 21:24:34.142062 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:24:34.142062 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:24:34.142062 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:24:34.142062 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:24:34.142062 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:24:34.142062 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:24:34.143044 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:24:34.143044 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:24:34.143044 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 21:24:34.143044 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 21:24:34.143044 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 21:24:34.143044 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 21:24:34.143044 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 21:24:34.143044 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 21:24:34.143044 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 25 21:24:34.143044 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Jul 25 21:24:34.143044 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 449/874] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 25 21:24:33 2022] GET /identity/v3/users/placement => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:24:34.149142 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29056f74-d37e-4c7f-aa46-e5520ae0b7ff None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:34.210971 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:34.267881 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29056f74-d37e-4c7f-aa46-e5520ae0b7ff None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:34.306602 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f4db08-501a-4e22-b4d4-ad00a8617e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:34.307462 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f4db08-501a-4e22-b4d4-ad00a8617e63 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:34.307748 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f4db08-501a-4e22-b4d4-ad00a8617e63 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:34.308165 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f4db08-501a-4e22-b4d4-ad00a8617e63 None admin] PATH_INFO: `/v3/users` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:34.309183 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f4db08-501a-4e22-b4d4-ad00a8617e63 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:24:34.309527 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f4db08-501a-4e22-b4d4-ad00a8617e63 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:34.311551 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f4db08-501a-4e22-b4d4-ad00a8617e63 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:34.334058 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 426/875] 10.222.0.66 () {56 vars in 1143 bytes} [Mon Jul 25 21:24:34 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:34.340685 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d634f1-2cb8-4855-a360-77ba6c2c3a4b None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:34.457867 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d634f1-2cb8-4855-a360-77ba6c2c3a4b None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:34.499619 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec41e35c-78a6-4fab-b002-8a999528671a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:34.500249 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec41e35c-78a6-4fab-b002-8a999528671a None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:34.500551 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec41e35c-78a6-4fab-b002-8a999528671a None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:34.500823 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec41e35c-78a6-4fab-b002-8a999528671a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:34.562009 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:34.577019 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec41e35c-78a6-4fab-b002-8a999528671a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:34.579217 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec41e35c-78a6-4fab-b002-8a999528671a None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:34.700100 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 450/876] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Jul 25 21:24:34 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 21:24:34.706204 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f4db08-501a-4e22-b4d4-ad00a8617e63 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:34.821196 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f4db08-501a-4e22-b4d4-ad00a8617e63 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:34.831579 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:34.858575 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4384cdbb-8c68-4011-8259-9ae8d9d581f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:34.859234 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4384cdbb-8c68-4011-8259-9ae8d9d581f1 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:34.859512 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4384cdbb-8c68-4011-8259-9ae8d9d581f1 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:34.859783 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4384cdbb-8c68-4011-8259-9ae8d9d581f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:34.870844 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4384cdbb-8c68-4011-8259-9ae8d9d581f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:34.872416 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4384cdbb-8c68-4011-8259-9ae8d9d581f1 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:34.888743 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application [None req-4384cdbb-8c68-4011-8259-9ae8d9d581f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:24:34.888743 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:24:34.888743 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:24:34.888743 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:24:34.888743 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:24:34.888743 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:24:34.888743 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:24:34.888743 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:24:34.888743 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:24:34.888743 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:24:34.888743 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:24:34.888743 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:24:34.888743 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:24:34.888743 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:24:34.888743 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:24:34.889787 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:24:34.889787 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:24:34.889787 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:24:34.889787 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:24:34.889787 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:24:34.889787 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:24:34.889787 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:24:34.889787 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:24:34.889787 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application with Lock( Jul 25 21:24:34.889787 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:24:34.889787 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:24:34.889787 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:24:34.889787 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:24:34.889787 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:24:34.889787 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:24:34.889787 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:24:34.889787 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:24:34.891230 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:24:34.891230 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:24:34.891230 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:24:34.891230 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Jul 25 21:24:34.891230 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 427/877] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 25 21:24:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:24:34.896428 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec41e35c-78a6-4fab-b002-8a999528671a None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:35.007566 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:35.021780 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec41e35c-78a6-4fab-b002-8a999528671a None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:35.059521 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c034c25-f2ee-4f76-a998-049b500ccfed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:35.060247 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c034c25-f2ee-4f76-a998-049b500ccfed None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:35.060560 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c034c25-f2ee-4f76-a998-049b500ccfed None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:35.061024 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c034c25-f2ee-4f76-a998-049b500ccfed None admin] PATH_INFO: `/v3/domains` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:35.061760 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c034c25-f2ee-4f76-a998-049b500ccfed None admin] RBAC: Adding query filter params (name=Default) {{(pid=87209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:24:35.062084 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c034c25-f2ee-4f76-a998-049b500ccfed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:35.064015 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c034c25-f2ee-4f76-a998-049b500ccfed None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:35.076800 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 451/878] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Jul 25 21:24:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:35.083332 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4384cdbb-8c68-4011-8259-9ae8d9d581f1 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:35.199545 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4384cdbb-8c68-4011-8259-9ae8d9d581f1 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:35.237471 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14be196e-bdc4-416a-a581-91b11e91f6d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:35.238121 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14be196e-bdc4-416a-a581-91b11e91f6d1 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:35.238410 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14be196e-bdc4-416a-a581-91b11e91f6d1 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:35.238669 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14be196e-bdc4-416a-a581-91b11e91f6d1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:35.246116 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14be196e-bdc4-416a-a581-91b11e91f6d1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:35.247646 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14be196e-bdc4-416a-a581-91b11e91f6d1 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:35.261604 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application [None req-14be196e-bdc4-416a-a581-91b11e91f6d1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:24:35.261604 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:24:35.261604 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:24:35.261604 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:24:35.261604 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:24:35.261604 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:24:35.261604 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:24:35.261604 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:24:35.261604 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:24:35.261604 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:24:35.261604 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:24:35.261604 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:24:35.261604 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 21:24:35.261604 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 21:24:35.261604 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 21:24:35.262563 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 21:24:35.262563 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:24:35.262563 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:24:35.262563 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:24:35.262563 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:24:35.262563 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:24:35.262563 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:24:35.262563 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:24:35.262563 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application with Lock( Jul 25 21:24:35.262563 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:24:35.262563 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:24:35.262563 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:24:35.262563 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:24:35.262563 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:24:35.262563 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:24:35.262563 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:24:35.262563 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:24:35.264032 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 21:24:35.264032 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 21:24:35.264032 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 21:24:35.264032 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 21:24:35.264032 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 21:24:35.264032 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 21:24:35.264032 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:24:35.264032 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Jul 25 21:24:35.264032 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 428/879] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Jul 25 21:24:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:24:35.268992 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c034c25-f2ee-4f76-a998-049b500ccfed None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:35.392991 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c034c25-f2ee-4f76-a998-049b500ccfed None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:35.430588 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e7e49d-7a30-4ee8-af27-f25a35e8f25b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:35.431352 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e7e49d-7a30-4ee8-af27-f25a35e8f25b None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:35.431663 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e7e49d-7a30-4ee8-af27-f25a35e8f25b None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:35.431936 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e7e49d-7a30-4ee8-af27-f25a35e8f25b None admin] PATH_INFO: `/v3/projects` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:35.432824 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e7e49d-7a30-4ee8-af27-f25a35e8f25b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:24:35.433315 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e7e49d-7a30-4ee8-af27-f25a35e8f25b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:35.434943 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e7e49d-7a30-4ee8-af27-f25a35e8f25b None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:35.448899 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 452/880] 10.222.0.66 () {56 vars in 1148 bytes} [Mon Jul 25 21:24:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:35.456745 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14be196e-bdc4-416a-a581-91b11e91f6d1 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:35.482322 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:35.567226 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14be196e-bdc4-416a-a581-91b11e91f6d1 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:35.610609 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848ccaf6-1de8-4559-a736-5495824aa555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:35.611266 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848ccaf6-1de8-4559-a736-5495824aa555 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:35.611621 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848ccaf6-1de8-4559-a736-5495824aa555 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:35.611959 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848ccaf6-1de8-4559-a736-5495824aa555 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:35.612924 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848ccaf6-1de8-4559-a736-5495824aa555 None admin] RBAC: Adding query filter params (role.id=216a86497a3a4593ba08730ea8697df3, scope.project.id=7e36d923af474a07adb12209580f12e1, user.id=3e0e5ab2acc3425c9d820f2027f5652b) {{(pid=87210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:24:35.613360 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848ccaf6-1de8-4559-a736-5495824aa555 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:35.615173 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848ccaf6-1de8-4559-a736-5495824aa555 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:35.629212 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 429/881] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Jul 25 21:24:35 2022] GET /identity/v3/role_assignments?user.id=3e0e5ab2acc3425c9d820f2027f5652b&scope.project.id=7e36d923af474a07adb12209580f12e1&role.id=216a86497a3a4593ba08730ea8697df3 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:37.863231 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f2e59a-6169-48fe-bced-6dfa77a66b80 None None] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:37.863830 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f2e59a-6169-48fe-bced-6dfa77a66b80 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:37.863830 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f2e59a-6169-48fe-bced-6dfa77a66b80 None None] PATH_INFO: `/` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:37.865189 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 453/882] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:24:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 21:24:37.871654 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb1c8d0-d1a3-49ab-a8cb-5832d01614e9 None None] REQUEST_METHOD: `POST` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:37.872412 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb1c8d0-d1a3-49ab-a8cb-5832d01614e9 None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:37.872568 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb1c8d0-d1a3-49ab-a8cb-5832d01614e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:37.901456 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.auth.core [None req-0eb1c8d0-d1a3-49ab-a8cb-5832d01614e9 None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:24:37.902647 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.fernet_utils [None req-0eb1c8d0-d1a3-49ab-a8cb-5832d01614e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:24:37.975647 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 430/883] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:24:37 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 21:24:38.005478 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f2e59a-6169-48fe-bced-6dfa77a66b80 None None] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:38.017604 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:38.140166 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f2e59a-6169-48fe-bced-6dfa77a66b80 None None] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:38.176873 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05099aa6-3251-4d74-a8f2-6ff1a7cc48f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:38.177553 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05099aa6-3251-4d74-a8f2-6ff1a7cc48f6 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:38.177829 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05099aa6-3251-4d74-a8f2-6ff1a7cc48f6 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:38.178100 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05099aa6-3251-4d74-a8f2-6ff1a7cc48f6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:38.190187 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05099aa6-3251-4d74-a8f2-6ff1a7cc48f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:24:38.195374 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application [None req-05099aa6-3251-4d74-a8f2-6ff1a7cc48f6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 21:24:38.195374 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:24:38.195374 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:24:38.195374 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:24:38.195374 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:24:38.195374 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:24:38.195374 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:24:38.195374 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:24:38.195374 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:24:38.195374 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:24:38.195374 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:24:38.195374 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:24:38.195374 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:24:38.195374 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:24:38.195374 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:24:38.195374 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:24:38.196428 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:24:38.196428 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:24:38.196428 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:24:38.196428 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:24:38.196428 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:24:38.196428 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:24:38.196428 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:24:38.196428 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:24:38.196428 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:24:38.196428 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:24:38.196428 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:24:38.196428 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application with Lock( Jul 25 21:24:38.196428 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:24:38.196428 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:24:38.196428 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:24:38.196428 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:24:38.197466 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:24:38.197466 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:24:38.197466 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:24:38.197466 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:24:38.197466 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:24:38.197466 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:24:38.197466 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:24:38.197466 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:24:38.197466 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:24:38.197466 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:24:38.197466 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 21:24:38.197466 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Jul 25 21:24:38.197466 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 454/884] 10.222.0.66 () {56 vars in 1096 bytes} [Mon Jul 25 21:24:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:24:38.203457 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb1c8d0-d1a3-49ab-a8cb-5832d01614e9 None None] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:38.227937 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:38.323268 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb1c8d0-d1a3-49ab-a8cb-5832d01614e9 None None] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:38.362338 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9458a105-a725-4fb6-910a-e6c50d0fc3fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:38.362970 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9458a105-a725-4fb6-910a-e6c50d0fc3fc None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:38.363246 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9458a105-a725-4fb6-910a-e6c50d0fc3fc None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:38.363516 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9458a105-a725-4fb6-910a-e6c50d0fc3fc None admin] PATH_INFO: `/v3/roles` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:38.364224 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9458a105-a725-4fb6-910a-e6c50d0fc3fc None admin] RBAC: Adding query filter params (name=admin) {{(pid=87210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:24:38.364529 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9458a105-a725-4fb6-910a-e6c50d0fc3fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:38.366245 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9458a105-a725-4fb6-910a-e6c50d0fc3fc None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:38.374164 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 431/885] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Jul 25 21:24:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:38.382639 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05099aa6-3251-4d74-a8f2-6ff1a7cc48f6 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:38.462454 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:38.497662 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05099aa6-3251-4d74-a8f2-6ff1a7cc48f6 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:38.534545 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9f60ae-61d1-4b1e-8311-0491bebffdd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:38.535482 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9f60ae-61d1-4b1e-8311-0491bebffdd9 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:38.535856 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9f60ae-61d1-4b1e-8311-0491bebffdd9 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:38.536223 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9f60ae-61d1-4b1e-8311-0491bebffdd9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:38.553466 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9f60ae-61d1-4b1e-8311-0491bebffdd9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:38.554947 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9f60ae-61d1-4b1e-8311-0491bebffdd9 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:38.569967 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application [None req-8f9f60ae-61d1-4b1e-8311-0491bebffdd9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:24:38.569967 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:24:38.569967 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:24:38.569967 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:24:38.569967 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:24:38.569967 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:24:38.569967 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:24:38.569967 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:24:38.569967 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:24:38.569967 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:24:38.569967 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:24:38.569967 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:24:38.569967 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:24:38.569967 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:24:38.569967 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:24:38.571568 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:24:38.571568 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:24:38.571568 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:24:38.571568 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:24:38.571568 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:24:38.571568 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:24:38.571568 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:24:38.571568 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:24:38.571568 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application with Lock( Jul 25 21:24:38.571568 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:24:38.571568 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:24:38.571568 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:24:38.571568 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:24:38.571568 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:24:38.571568 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:24:38.571568 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:24:38.571568 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:24:38.573646 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:24:38.573646 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:24:38.573646 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:24:38.573646 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Jul 25 21:24:38.573646 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 455/886] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 25 21:24:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:24:38.580225 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9458a105-a725-4fb6-910a-e6c50d0fc3fc None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:38.673905 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:38.701487 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9458a105-a725-4fb6-910a-e6c50d0fc3fc None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:38.740250 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d699a84-8345-4327-9ec2-735d17bdaee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:38.740871 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d699a84-8345-4327-9ec2-735d17bdaee4 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:38.741132 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d699a84-8345-4327-9ec2-735d17bdaee4 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:38.741447 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d699a84-8345-4327-9ec2-735d17bdaee4 None admin] PATH_INFO: `/v3/domains` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:38.742153 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d699a84-8345-4327-9ec2-735d17bdaee4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:24:38.742455 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d699a84-8345-4327-9ec2-735d17bdaee4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:38.743862 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d699a84-8345-4327-9ec2-735d17bdaee4 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:38.755758 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 432/887] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Jul 25 21:24:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:38.764725 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9f60ae-61d1-4b1e-8311-0491bebffdd9 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:38.873429 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9f60ae-61d1-4b1e-8311-0491bebffdd9 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:38.893556 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:38.917562 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1f7b45-b5e1-4f0f-b5f3-0cb4200fe0d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:38.918205 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1f7b45-b5e1-4f0f-b5f3-0cb4200fe0d7 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:38.918485 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1f7b45-b5e1-4f0f-b5f3-0cb4200fe0d7 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:38.918760 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1f7b45-b5e1-4f0f-b5f3-0cb4200fe0d7 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:38.926766 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1f7b45-b5e1-4f0f-b5f3-0cb4200fe0d7 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:38.928196 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1f7b45-b5e1-4f0f-b5f3-0cb4200fe0d7 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:38.939903 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application [None req-8a1f7b45-b5e1-4f0f-b5f3-0cb4200fe0d7 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 25 21:24:38.939903 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:24:38.939903 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:24:38.939903 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:24:38.939903 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:24:38.939903 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:24:38.939903 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:24:38.939903 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:24:38.939903 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:24:38.939903 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:24:38.939903 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:24:38.939903 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:24:38.939903 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 21:24:38.939903 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 21:24:38.939903 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 21:24:38.939903 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 21:24:38.940941 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:24:38.940941 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:24:38.940941 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 21:24:38.940941 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:24:38.940941 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 21:24:38.940941 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:24:38.940941 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:24:38.940941 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:24:38.940941 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:24:38.940941 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:24:38.940941 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:24:38.940941 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application with Lock( Jul 25 21:24:38.940941 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:24:38.940941 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:24:38.940941 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:24:38.940941 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:24:38.940941 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:24:38.940941 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:24:38.941985 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:24:38.941985 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:24:38.941985 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 21:24:38.941985 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 21:24:38.941985 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 21:24:38.941985 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 21:24:38.941985 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 21:24:38.941985 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 21:24:38.941985 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 25 21:24:38.941985 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Jul 25 21:24:38.941985 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 456/888] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 25 21:24:38 2022] GET /identity/v3/users/placement => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:24:38.948906 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d699a84-8345-4327-9ec2-735d17bdaee4 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:39.058749 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d699a84-8345-4327-9ec2-735d17bdaee4 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:39.094961 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2cc769-786b-4399-90d6-35c777531c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:39.095578 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2cc769-786b-4399-90d6-35c777531c0e None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:39.095849 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2cc769-786b-4399-90d6-35c777531c0e None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:39.096116 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2cc769-786b-4399-90d6-35c777531c0e None admin] PATH_INFO: `/v3/users` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:39.096905 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2cc769-786b-4399-90d6-35c777531c0e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:24:39.097243 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2cc769-786b-4399-90d6-35c777531c0e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:39.098679 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2cc769-786b-4399-90d6-35c777531c0e None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:39.101514 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:39.117410 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 433/889] 10.222.0.66 () {56 vars in 1143 bytes} [Mon Jul 25 21:24:38 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:39.123538 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1f7b45-b5e1-4f0f-b5f3-0cb4200fe0d7 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:39.231010 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1f7b45-b5e1-4f0f-b5f3-0cb4200fe0d7 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:39.267512 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbff254-e106-40c7-9dce-8c074be6c00f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:39.268150 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbff254-e106-40c7-9dce-8c074be6c00f None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:39.268433 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbff254-e106-40c7-9dce-8c074be6c00f None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:39.268707 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbff254-e106-40c7-9dce-8c074be6c00f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:39.281043 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbff254-e106-40c7-9dce-8c074be6c00f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:39.282531 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbff254-e106-40c7-9dce-8c074be6c00f None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:39.298942 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application [None req-cbbff254-e106-40c7-9dce-8c074be6c00f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:24:39.298942 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:24:39.298942 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:24:39.298942 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:24:39.298942 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:24:39.298942 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:24:39.298942 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:24:39.298942 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:24:39.298942 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:24:39.298942 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:24:39.298942 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:24:39.298942 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:24:39.298942 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:24:39.298942 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:24:39.298942 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:24:39.299939 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:24:39.299939 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:24:39.299939 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:24:39.299939 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:24:39.299939 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:24:39.299939 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:24:39.299939 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:24:39.299939 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:24:39.299939 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application with Lock( Jul 25 21:24:39.299939 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:24:39.299939 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:24:39.299939 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:24:39.299939 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:24:39.299939 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:24:39.299939 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:24:39.299939 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:24:39.299939 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:24:39.301032 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:24:39.301032 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:24:39.301032 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:24:39.301032 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Jul 25 21:24:39.301032 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 457/890] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 25 21:24:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:24:39.306491 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2cc769-786b-4399-90d6-35c777531c0e None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:39.423761 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2cc769-786b-4399-90d6-35c777531c0e None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:39.459597 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1115ce8f-5e2d-4617-8281-5a07dccd7e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:39.460217 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1115ce8f-5e2d-4617-8281-5a07dccd7e74 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:39.460495 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1115ce8f-5e2d-4617-8281-5a07dccd7e74 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:39.460869 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1115ce8f-5e2d-4617-8281-5a07dccd7e74 None admin] PATH_INFO: `/v3/domains` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:39.461729 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1115ce8f-5e2d-4617-8281-5a07dccd7e74 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:24:39.462034 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1115ce8f-5e2d-4617-8281-5a07dccd7e74 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:39.463427 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1115ce8f-5e2d-4617-8281-5a07dccd7e74 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:39.475801 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 434/891] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Jul 25 21:24:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:39.482624 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbff254-e106-40c7-9dce-8c074be6c00f None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:39.519149 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:39.594707 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbff254-e106-40c7-9dce-8c074be6c00f None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:39.637107 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b39622-5dbb-4614-b616-9d9f44b928a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:39.637782 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b39622-5dbb-4614-b616-9d9f44b928a9 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:39.638063 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b39622-5dbb-4614-b616-9d9f44b928a9 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:39.638338 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b39622-5dbb-4614-b616-9d9f44b928a9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:39.645321 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b39622-5dbb-4614-b616-9d9f44b928a9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:39.646780 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b39622-5dbb-4614-b616-9d9f44b928a9 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:39.658464 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application [None req-b7b39622-5dbb-4614-b616-9d9f44b928a9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:24:39.658464 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:24:39.658464 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:24:39.658464 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:24:39.658464 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:24:39.658464 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:24:39.658464 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:24:39.658464 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:24:39.658464 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:24:39.658464 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:24:39.658464 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:24:39.658464 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:24:39.658464 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 21:24:39.658464 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 21:24:39.658464 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 21:24:39.659458 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 21:24:39.659458 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:24:39.659458 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:24:39.659458 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:24:39.659458 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:24:39.659458 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:24:39.659458 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:24:39.659458 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:24:39.659458 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application with Lock( Jul 25 21:24:39.659458 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:24:39.659458 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:24:39.659458 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:24:39.659458 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:24:39.659458 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:24:39.659458 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:24:39.659458 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:24:39.659458 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:24:39.660389 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 21:24:39.660389 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 21:24:39.660389 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 21:24:39.660389 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 21:24:39.660389 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 21:24:39.660389 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 21:24:39.660389 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:24:39.660389 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Jul 25 21:24:39.660389 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 458/892] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Jul 25 21:24:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:24:39.666352 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1115ce8f-5e2d-4617-8281-5a07dccd7e74 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:39.723664 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:39.771493 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1115ce8f-5e2d-4617-8281-5a07dccd7e74 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:39.809502 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4797c39c-55e7-4699-8847-10808b8fb7ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:39.810121 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4797c39c-55e7-4699-8847-10808b8fb7ab None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:39.810400 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4797c39c-55e7-4699-8847-10808b8fb7ab None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:39.810674 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4797c39c-55e7-4699-8847-10808b8fb7ab None admin] PATH_INFO: `/v3/projects` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:39.811426 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4797c39c-55e7-4699-8847-10808b8fb7ab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:24:39.811731 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4797c39c-55e7-4699-8847-10808b8fb7ab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:39.813204 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4797c39c-55e7-4699-8847-10808b8fb7ab None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:39.832626 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 435/893] 10.222.0.66 () {56 vars in 1148 bytes} [Mon Jul 25 21:24:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:24:39.840920 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b39622-5dbb-4614-b616-9d9f44b928a9 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:39.939317 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:39.950414 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b39622-5dbb-4614-b616-9d9f44b928a9 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:39.990439 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0546457f-4deb-456a-b24d-dafd75c57e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:39.991003 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0546457f-4deb-456a-b24d-dafd75c57e4b None admin] REQUEST_METHOD: `PUT` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:39.991273 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0546457f-4deb-456a-b24d-dafd75c57e4b None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:39.991540 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0546457f-4deb-456a-b24d-dafd75c57e4b None admin] PATH_INFO: `/v3/projects/7e36d923af474a07adb12209580f12e1/users/3e0e5ab2acc3425c9d820f2027f5652b/roles/216a86497a3a4593ba08730ea8697df3` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:39.993714 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0546457f-4deb-456a-b24d-dafd75c57e4b None admin] RBAC: Authorizing `identity:create_grant(project_id=7e36d923af474a07adb12209580f12e1, user_id=3e0e5ab2acc3425c9d820f2027f5652b, role_id=216a86497a3a4593ba08730ea8697df3)` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:39.995269 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0546457f-4deb-456a-b24d-dafd75c57e4b None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:40.009602 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 459/894] 10.222.0.66 () {58 vars in 1439 bytes} [Mon Jul 25 21:24:39 2022] PUT /identity/v3/projects/7e36d923af474a07adb12209580f12e1/users/3e0e5ab2acc3425c9d820f2027f5652b/roles/216a86497a3a4593ba08730ea8697df3 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 21:24:42.241348 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0411de23-a087-48d2-9a17-43c1a7362025 None None] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:42.242327 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0411de23-a087-48d2-9a17-43c1a7362025 None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:42.242327 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0411de23-a087-48d2-9a17-43c1a7362025 None None] PATH_INFO: `/` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:42.243777 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 436/895] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:24:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:24:42.249385 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ce5792-f4eb-4c90-8bb6-f6750e339e89 None None] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:42.249883 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ce5792-f4eb-4c90-8bb6-f6750e339e89 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:42.249883 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ce5792-f4eb-4c90-8bb6-f6750e339e89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:42.268507 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.auth.core [None req-56ce5792-f4eb-4c90-8bb6-f6750e339e89 None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:24:42.269720 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-56ce5792-f4eb-4c90-8bb6-f6750e339e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:24:42.342403 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 460/896] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:24:42 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 21:24:42.368812 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0411de23-a087-48d2-9a17-43c1a7362025 None None] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:42.499579 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0411de23-a087-48d2-9a17-43c1a7362025 None None] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:42.515287 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:42.545459 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01b262e-3003-4894-b448-0997f2214d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:42.546094 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01b262e-3003-4894-b448-0997f2214d88 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:42.546468 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01b262e-3003-4894-b448-0997f2214d88 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:42.546742 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01b262e-3003-4894-b448-0997f2214d88 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:42.557668 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01b262e-3003-4894-b448-0997f2214d88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:24:42.562572 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application [None req-c01b262e-3003-4894-b448-0997f2214d88 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 21:24:42.562572 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:24:42.562572 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:24:42.562572 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:24:42.562572 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:24:42.562572 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:24:42.562572 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:24:42.562572 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:24:42.562572 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:24:42.562572 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:24:42.562572 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:24:42.562572 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:24:42.562572 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:24:42.562572 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:24:42.562572 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:24:42.562572 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:24:42.563653 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:24:42.563653 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:24:42.563653 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:24:42.563653 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:24:42.563653 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:24:42.563653 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:24:42.563653 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:24:42.563653 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:24:42.563653 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:24:42.563653 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:24:42.563653 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:24:42.563653 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application with Lock( Jul 25 21:24:42.563653 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:24:42.563653 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:24:42.563653 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:24:42.563653 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:24:42.564827 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:24:42.564827 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:24:42.564827 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:24:42.564827 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:24:42.564827 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:24:42.564827 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:24:42.564827 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:24:42.564827 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:24:42.564827 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:24:42.564827 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:24:42.564827 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 21:24:42.564827 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Jul 25 21:24:42.564827 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 437/897] 10.222.0.66 () {56 vars in 1096 bytes} [Mon Jul 25 21:24:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:24:42.570125 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ce5792-f4eb-4c90-8bb6-f6750e339e89 None None] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:42.666048 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:42.686696 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ce5792-f4eb-4c90-8bb6-f6750e339e89 None None] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:42.724582 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8030cc-14a0-473f-9a8a-069ab7204bfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:42.725326 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8030cc-14a0-473f-9a8a-069ab7204bfd None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:42.725607 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8030cc-14a0-473f-9a8a-069ab7204bfd None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:42.725879 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8030cc-14a0-473f-9a8a-069ab7204bfd None admin] PATH_INFO: `/v3/roles` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:42.727030 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8030cc-14a0-473f-9a8a-069ab7204bfd None admin] RBAC: Adding query filter params (name=admin) {{(pid=87209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:24:42.727343 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8030cc-14a0-473f-9a8a-069ab7204bfd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:42.728734 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8030cc-14a0-473f-9a8a-069ab7204bfd None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:42.737121 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 461/898] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Jul 25 21:24:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:42.745992 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01b262e-3003-4894-b448-0997f2214d88 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:42.851400 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01b262e-3003-4894-b448-0997f2214d88 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:42.888467 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66fd1bd-784e-466b-be15-96d69b5b426d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:42.889128 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66fd1bd-784e-466b-be15-96d69b5b426d None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:42.889409 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66fd1bd-784e-466b-be15-96d69b5b426d None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:42.889674 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66fd1bd-784e-466b-be15-96d69b5b426d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:42.900513 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66fd1bd-784e-466b-be15-96d69b5b426d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:42.902015 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66fd1bd-784e-466b-be15-96d69b5b426d None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:42.920050 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application [None req-b66fd1bd-784e-466b-be15-96d69b5b426d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:24:42.920050 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:24:42.920050 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:24:42.920050 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:24:42.920050 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:24:42.920050 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:24:42.920050 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:24:42.920050 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:24:42.920050 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:24:42.920050 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:24:42.920050 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:24:42.920050 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:24:42.920050 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:24:42.920050 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:24:42.920050 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:24:42.921122 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:24:42.921122 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:24:42.921122 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:24:42.921122 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:24:42.921122 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:24:42.921122 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:24:42.921122 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:24:42.921122 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:24:42.921122 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application with Lock( Jul 25 21:24:42.921122 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:24:42.921122 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:24:42.921122 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:24:42.921122 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:24:42.921122 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:24:42.921122 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:24:42.921122 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:24:42.921122 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:24:42.922059 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:24:42.922059 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:24:42.922059 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:24:42.922059 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Jul 25 21:24:42.922059 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 438/899] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 25 21:24:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:24:42.929709 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8030cc-14a0-473f-9a8a-069ab7204bfd None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:43.043103 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8030cc-14a0-473f-9a8a-069ab7204bfd None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:43.078168 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac278f5-6719-4abd-bc5a-50308bdd917c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:43.078802 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac278f5-6719-4abd-bc5a-50308bdd917c None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:43.079078 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac278f5-6719-4abd-bc5a-50308bdd917c None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:43.079349 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac278f5-6719-4abd-bc5a-50308bdd917c None admin] PATH_INFO: `/v3/domains` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:43.080029 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac278f5-6719-4abd-bc5a-50308bdd917c None admin] RBAC: Adding query filter params (name=Default) {{(pid=87209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:24:43.080329 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac278f5-6719-4abd-bc5a-50308bdd917c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:43.081745 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac278f5-6719-4abd-bc5a-50308bdd917c None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:43.093995 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 462/900] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Jul 25 21:24:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:43.103622 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66fd1bd-784e-466b-be15-96d69b5b426d None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:43.137311 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:43.215751 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66fd1bd-784e-466b-be15-96d69b5b426d None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:43.250623 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305a116c-1c25-4109-9095-eeec28989cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:43.251249 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305a116c-1c25-4109-9095-eeec28989cc3 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:43.251527 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305a116c-1c25-4109-9095-eeec28989cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:43.251774 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305a116c-1c25-4109-9095-eeec28989cc3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:43.259474 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305a116c-1c25-4109-9095-eeec28989cc3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:43.260920 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305a116c-1c25-4109-9095-eeec28989cc3 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:43.272214 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application [None req-305a116c-1c25-4109-9095-eeec28989cc3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 25 21:24:43.272214 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:24:43.272214 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:24:43.272214 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:24:43.272214 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:24:43.272214 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:24:43.272214 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:24:43.272214 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:24:43.272214 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:24:43.272214 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:24:43.272214 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:24:43.272214 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:24:43.272214 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 21:24:43.272214 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 21:24:43.272214 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 21:24:43.272214 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 21:24:43.273342 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:24:43.273342 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:24:43.273342 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 21:24:43.273342 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:24:43.273342 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 21:24:43.273342 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:24:43.273342 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:24:43.273342 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:24:43.273342 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:24:43.273342 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:24:43.273342 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:24:43.273342 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application with Lock( Jul 25 21:24:43.273342 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:24:43.273342 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:24:43.273342 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:24:43.273342 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:24:43.273342 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:24:43.273342 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:24:43.274649 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:24:43.274649 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:24:43.274649 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 21:24:43.274649 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 21:24:43.274649 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 21:24:43.274649 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 21:24:43.274649 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 21:24:43.274649 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 21:24:43.274649 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 25 21:24:43.274649 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Jul 25 21:24:43.274649 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 439/901] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 25 21:24:43 2022] GET /identity/v3/users/placement => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:24:43.281419 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac278f5-6719-4abd-bc5a-50308bdd917c None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:43.285717 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:43.386727 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac278f5-6719-4abd-bc5a-50308bdd917c None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:43.432044 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c034ac2a-487f-4b4a-806e-fb907a055ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:43.432679 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c034ac2a-487f-4b4a-806e-fb907a055ccd None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:43.432956 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c034ac2a-487f-4b4a-806e-fb907a055ccd None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:43.433252 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c034ac2a-487f-4b4a-806e-fb907a055ccd None admin] PATH_INFO: `/v3/users` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:43.434045 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c034ac2a-487f-4b4a-806e-fb907a055ccd None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:24:43.434345 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c034ac2a-487f-4b4a-806e-fb907a055ccd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:43.435791 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c034ac2a-487f-4b4a-806e-fb907a055ccd None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:43.454298 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 463/902] 10.222.0.66 () {56 vars in 1143 bytes} [Mon Jul 25 21:24:43 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:43.461190 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305a116c-1c25-4109-9095-eeec28989cc3 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:43.561159 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:43.576939 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305a116c-1c25-4109-9095-eeec28989cc3 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:43.612018 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ff98c1-1730-4ac7-8cd4-5bb30eef994b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:43.612638 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ff98c1-1730-4ac7-8cd4-5bb30eef994b None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:43.612913 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ff98c1-1730-4ac7-8cd4-5bb30eef994b None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:43.613210 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ff98c1-1730-4ac7-8cd4-5bb30eef994b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:43.704055 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ff98c1-1730-4ac7-8cd4-5bb30eef994b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:43.706191 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ff98c1-1730-4ac7-8cd4-5bb30eef994b None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:43.791256 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:43.813256 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 440/903] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Jul 25 21:24:43 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 21:24:43.820133 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c034ac2a-487f-4b4a-806e-fb907a055ccd None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:43.894951 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:43.935471 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c034ac2a-487f-4b4a-806e-fb907a055ccd None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:43.977689 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73e3904-468d-4b36-9da3-a98de6ce9f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:43.978273 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73e3904-468d-4b36-9da3-a98de6ce9f3c None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:43.978563 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73e3904-468d-4b36-9da3-a98de6ce9f3c None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:43.978824 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73e3904-468d-4b36-9da3-a98de6ce9f3c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:43.989709 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73e3904-468d-4b36-9da3-a98de6ce9f3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:43.991169 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73e3904-468d-4b36-9da3-a98de6ce9f3c None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:44.006922 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application [None req-f73e3904-468d-4b36-9da3-a98de6ce9f3c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:24:44.006922 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:24:44.006922 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:24:44.006922 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:24:44.006922 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:24:44.006922 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:24:44.006922 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:24:44.006922 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:24:44.006922 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:24:44.006922 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:24:44.006922 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:24:44.006922 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:24:44.006922 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:24:44.006922 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:24:44.006922 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:24:44.008023 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:24:44.008023 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:24:44.008023 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:24:44.008023 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:24:44.008023 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:24:44.008023 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:24:44.008023 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:24:44.008023 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:24:44.008023 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application with Lock( Jul 25 21:24:44.008023 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:24:44.008023 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:24:44.008023 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:24:44.008023 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:24:44.008023 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:24:44.008023 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:24:44.008023 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:24:44.008023 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:24:44.009129 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:24:44.009129 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:24:44.009129 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:24:44.009129 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Jul 25 21:24:44.009129 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 464/904] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 25 21:24:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:24:44.014715 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ff98c1-1730-4ac7-8cd4-5bb30eef994b None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:44.127505 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ff98c1-1730-4ac7-8cd4-5bb30eef994b None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:44.166862 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a28b0a2-c874-4b70-80cc-8ee19b33ee52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:44.167472 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a28b0a2-c874-4b70-80cc-8ee19b33ee52 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:44.167748 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a28b0a2-c874-4b70-80cc-8ee19b33ee52 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:44.168021 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a28b0a2-c874-4b70-80cc-8ee19b33ee52 None admin] PATH_INFO: `/v3/domains` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:44.168710 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a28b0a2-c874-4b70-80cc-8ee19b33ee52 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:24:44.169012 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a28b0a2-c874-4b70-80cc-8ee19b33ee52 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:44.170423 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a28b0a2-c874-4b70-80cc-8ee19b33ee52 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:44.181435 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 441/905] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Jul 25 21:24:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:44.187409 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73e3904-468d-4b36-9da3-a98de6ce9f3c None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:44.302610 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73e3904-468d-4b36-9da3-a98de6ce9f3c None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:44.317411 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:44.352845 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3992217b-6556-40fa-a9b3-7d2fc17a1f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:44.353521 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3992217b-6556-40fa-a9b3-7d2fc17a1f3e None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:44.353800 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3992217b-6556-40fa-a9b3-7d2fc17a1f3e None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:44.354075 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3992217b-6556-40fa-a9b3-7d2fc17a1f3e None admin] PATH_INFO: `/v3/projects/service` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:44.361382 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3992217b-6556-40fa-a9b3-7d2fc17a1f3e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:44.362834 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3992217b-6556-40fa-a9b3-7d2fc17a1f3e None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:44.374666 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application [None req-3992217b-6556-40fa-a9b3-7d2fc17a1f3e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:24:44.374666 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:24:44.374666 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:24:44.374666 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:24:44.374666 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:24:44.374666 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:24:44.374666 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:24:44.374666 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:24:44.374666 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:24:44.374666 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:24:44.374666 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:24:44.374666 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:24:44.374666 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 21:24:44.374666 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 21:24:44.374666 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 21:24:44.375670 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 21:24:44.375670 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:24:44.375670 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:24:44.375670 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:24:44.375670 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:24:44.375670 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:24:44.375670 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:24:44.375670 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:24:44.375670 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application with Lock( Jul 25 21:24:44.375670 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:24:44.375670 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:24:44.375670 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:24:44.375670 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:24:44.375670 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:24:44.375670 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:24:44.375670 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:24:44.375670 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:24:44.376800 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 21:24:44.376800 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 21:24:44.376800 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 21:24:44.376800 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 21:24:44.376800 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 21:24:44.376800 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 21:24:44.376800 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:24:44.376800 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: ERROR keystone.server.flask.application Jul 25 21:24:44.376800 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 465/906] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Jul 25 21:24:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:24:44.382489 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a28b0a2-c874-4b70-80cc-8ee19b33ee52 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:44.434253 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:44.491846 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a28b0a2-c874-4b70-80cc-8ee19b33ee52 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:44.533386 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb10644-2488-46b2-b7bf-56119bedda11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:44.534281 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb10644-2488-46b2-b7bf-56119bedda11 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:44.534647 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb10644-2488-46b2-b7bf-56119bedda11 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:44.535000 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb10644-2488-46b2-b7bf-56119bedda11 None admin] PATH_INFO: `/v3/projects` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:44.536145 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb10644-2488-46b2-b7bf-56119bedda11 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:24:44.536576 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb10644-2488-46b2-b7bf-56119bedda11 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:44.539604 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb10644-2488-46b2-b7bf-56119bedda11 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:44.557705 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 442/907] 10.222.0.66 () {56 vars in 1148 bytes} [Mon Jul 25 21:24:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:24:44.567152 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3992217b-6556-40fa-a9b3-7d2fc17a1f3e None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:44.680387 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3992217b-6556-40fa-a9b3-7d2fc17a1f3e None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:44.715483 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f88d292-45d1-427e-8547-6af4be1a8cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:44.716097 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f88d292-45d1-427e-8547-6af4be1a8cd1 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:44.716375 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f88d292-45d1-427e-8547-6af4be1a8cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:44.716647 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f88d292-45d1-427e-8547-6af4be1a8cd1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:44.717454 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f88d292-45d1-427e-8547-6af4be1a8cd1 None admin] RBAC: Adding query filter params (role.id=216a86497a3a4593ba08730ea8697df3, scope.project.id=7e36d923af474a07adb12209580f12e1, user.id=3e0e5ab2acc3425c9d820f2027f5652b) {{(pid=87209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:24:44.717767 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f88d292-45d1-427e-8547-6af4be1a8cd1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:44.719201 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f88d292-45d1-427e-8547-6af4be1a8cd1 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:44.725138 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 466/908] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Jul 25 21:24:44 2022] GET /identity/v3/role_assignments?user.id=3e0e5ab2acc3425c9d820f2027f5652b&scope.project.id=7e36d923af474a07adb12209580f12e1&role.id=216a86497a3a4593ba08730ea8697df3 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:46.979027 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483e310d-657f-4bf4-9238-bcf016efce28 None None] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:46.979569 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483e310d-657f-4bf4-9238-bcf016efce28 None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:46.979569 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483e310d-657f-4bf4-9238-bcf016efce28 None None] PATH_INFO: `/` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:46.980938 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 443/909] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:24:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:24:46.988310 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d5d07b-1b6f-4f90-b557-cb8c7c9d2c27 None None] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:46.988981 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d5d07b-1b6f-4f90-b557-cb8c7c9d2c27 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:46.989137 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d5d07b-1b6f-4f90-b557-cb8c7c9d2c27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:47.010992 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.auth.core [None req-b8d5d07b-1b6f-4f90-b557-cb8c7c9d2c27 None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:24:47.012172 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-b8d5d07b-1b6f-4f90-b557-cb8c7c9d2c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:24:47.047609 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:47.099593 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 467/910] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:24:46 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 21:24:47.123626 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483e310d-657f-4bf4-9238-bcf016efce28 None None] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:47.238273 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483e310d-657f-4bf4-9238-bcf016efce28 None None] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:47.246032 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:47.274560 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbe8701-483e-4dcb-bc68-725a2a425213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:47.275208 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbe8701-483e-4dcb-bc68-725a2a425213 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:47.275480 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbe8701-483e-4dcb-bc68-725a2a425213 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:47.275745 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbe8701-483e-4dcb-bc68-725a2a425213 None admin] PATH_INFO: `/v3/services/placement` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:47.276366 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbe8701-483e-4dcb-bc68-725a2a425213 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:47.277768 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbe8701-483e-4dcb-bc68-725a2a425213 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:47.286518 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application [None req-cbbe8701-483e-4dcb-bc68-725a2a425213 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 21:24:47.286518 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:24:47.286518 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 21:24:47.286518 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 21:24:47.286518 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 21:24:47.286518 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 21:24:47.286518 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 21:24:47.286518 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 21:24:47.286518 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 21:24:47.286518 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Jul 25 21:24:47.286518 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 21:24:47.286518 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Jul 25 21:24:47.286518 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:24:47.286518 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:24:47.286518 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:24:47.286518 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:24:47.286518 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:24:47.287705 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:24:47.287705 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:24:47.287705 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:24:47.287705 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:24:47.287705 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:24:47.287705 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:24:47.287705 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 21:24:47.287705 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 21:24:47.287705 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 21:24:47.287705 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 21:24:47.287705 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:24:47.287705 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:24:47.287705 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:24:47.287705 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:24:47.287705 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:24:47.287705 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:24:47.289208 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:24:47.289208 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application with Lock( Jul 25 21:24:47.289208 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:24:47.289208 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:24:47.289208 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:24:47.289208 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:24:47.289208 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:24:47.289208 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:24:47.289208 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:24:47.289208 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:24:47.289208 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 21:24:47.289208 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 21:24:47.289208 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 21:24:47.289208 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Jul 25 21:24:47.289208 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 444/911] 10.222.0.66 () {56 vars in 1117 bytes} [Mon Jul 25 21:24:47 2022] GET /identity/v3/services/placement => generated 90 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:24:47.294370 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d5d07b-1b6f-4f90-b557-cb8c7c9d2c27 None None] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:47.404086 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d5d07b-1b6f-4f90-b557-cb8c7c9d2c27 None None] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:47.450029 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae7c45d-a614-41af-bcfd-de8585104512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:47.450661 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae7c45d-a614-41af-bcfd-de8585104512 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:47.450919 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae7c45d-a614-41af-bcfd-de8585104512 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:47.451189 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae7c45d-a614-41af-bcfd-de8585104512 None admin] PATH_INFO: `/v3/services` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:47.451868 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae7c45d-a614-41af-bcfd-de8585104512 None admin] RBAC: Adding query filter params (name=placement) {{(pid=87209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:24:47.452171 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae7c45d-a614-41af-bcfd-de8585104512 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:47.453599 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae7c45d-a614-41af-bcfd-de8585104512 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:47.459468 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 468/912] 10.222.0.66 () {56 vars in 1116 bytes} [Mon Jul 25 21:24:47 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:47.466088 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbe8701-483e-4dcb-bc68-725a2a425213 None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:47.576715 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbe8701-483e-4dcb-bc68-725a2a425213 None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:47.613101 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94075488-e091-454c-b2b3-8e1e20865e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:47.613737 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94075488-e091-454c-b2b3-8e1e20865e17 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:47.614015 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94075488-e091-454c-b2b3-8e1e20865e17 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:47.614585 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94075488-e091-454c-b2b3-8e1e20865e17 None admin] PATH_INFO: `/v3/services` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:47.615838 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94075488-e091-454c-b2b3-8e1e20865e17 None admin] RBAC: Adding query filter params (type=placement) {{(pid=87210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:24:47.616356 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94075488-e091-454c-b2b3-8e1e20865e17 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:47.618377 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94075488-e091-454c-b2b3-8e1e20865e17 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:47.623839 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 445/913] 10.222.0.66 () {56 vars in 1116 bytes} [Mon Jul 25 21:24:47 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:49.869902 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181cf8ef-337d-4a9e-b59d-32e593b2668a None None] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:49.870520 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181cf8ef-337d-4a9e-b59d-32e593b2668a None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:49.870520 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181cf8ef-337d-4a9e-b59d-32e593b2668a None None] PATH_INFO: `/` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:49.871858 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 469/914] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:24:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:24:49.878214 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a6dd0e-4565-4316-b252-d017465f169a None None] REQUEST_METHOD: `POST` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:49.878917 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a6dd0e-4565-4316-b252-d017465f169a None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:49.879073 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a6dd0e-4565-4316-b252-d017465f169a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:49.904705 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.auth.core [None req-e4a6dd0e-4565-4316-b252-d017465f169a None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:24:49.905937 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.fernet_utils [None req-e4a6dd0e-4565-4316-b252-d017465f169a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:24:49.936445 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:49.982454 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 446/915] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:24:49 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 21:24:50.005981 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181cf8ef-337d-4a9e-b59d-32e593b2668a None None] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:50.043357 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:50.123745 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181cf8ef-337d-4a9e-b59d-32e593b2668a None None] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:50.160206 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd1c2e1-50b6-47f3-982e-eba3c69332a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:50.160824 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd1c2e1-50b6-47f3-982e-eba3c69332a4 None admin] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:50.161120 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd1c2e1-50b6-47f3-982e-eba3c69332a4 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:50.161393 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd1c2e1-50b6-47f3-982e-eba3c69332a4 None admin] PATH_INFO: `/v3/services` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:50.162076 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd1c2e1-50b6-47f3-982e-eba3c69332a4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:50.163467 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd1c2e1-50b6-47f3-982e-eba3c69332a4 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:50.186567 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 470/916] 10.222.0.66 () {60 vars in 1141 bytes} [Mon Jul 25 21:24:50 2022] POST /identity/v3/services => generated 246 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 21:24:52.441431 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8e40c3-ca7f-4a35-90fa-28fd6a1e99fa None None] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:52.442030 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8e40c3-ca7f-4a35-90fa-28fd6a1e99fa None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:52.442030 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8e40c3-ca7f-4a35-90fa-28fd6a1e99fa None None] PATH_INFO: `/` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:52.443349 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 447/917] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:24:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:24:52.450113 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12021101-c435-467f-b195-29cfef582876 None None] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:52.450810 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12021101-c435-467f-b195-29cfef582876 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:52.450989 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12021101-c435-467f-b195-29cfef582876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:52.479273 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.auth.core [None req-12021101-c435-467f-b195-29cfef582876 None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:24:52.480500 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-12021101-c435-467f-b195-29cfef582876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:24:52.558774 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 471/918] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:24:52 2022] POST /identity/v3/auth/tokens => generated 1962 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 21:24:52.583202 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8e40c3-ca7f-4a35-90fa-28fd6a1e99fa None None] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:52.705156 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8e40c3-ca7f-4a35-90fa-28fd6a1e99fa None None] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:52.740775 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b13a39-515a-4ecb-9cff-5806f3462bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:52.741435 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b13a39-515a-4ecb-9cff-5806f3462bcf None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:52.741710 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b13a39-515a-4ecb-9cff-5806f3462bcf None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:52.742192 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b13a39-515a-4ecb-9cff-5806f3462bcf None admin] PATH_INFO: `/v3/services/placement` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:52.742815 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b13a39-515a-4ecb-9cff-5806f3462bcf None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:52.744191 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b13a39-515a-4ecb-9cff-5806f3462bcf None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:52.753262 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application [None req-78b13a39-515a-4ecb-9cff-5806f3462bcf None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 21:24:52.753262 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:24:52.753262 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 21:24:52.753262 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 21:24:52.753262 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 21:24:52.753262 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 21:24:52.753262 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 21:24:52.753262 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 21:24:52.753262 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 21:24:52.753262 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Jul 25 21:24:52.753262 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 21:24:52.753262 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Jul 25 21:24:52.753262 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:24:52.753262 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:24:52.753262 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:24:52.753262 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:24:52.753262 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:24:52.754384 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:24:52.754384 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:24:52.754384 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:24:52.754384 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:24:52.754384 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:24:52.754384 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:24:52.754384 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 21:24:52.754384 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 21:24:52.754384 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 21:24:52.754384 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 21:24:52.754384 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:24:52.754384 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:24:52.754384 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:24:52.754384 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:24:52.754384 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:24:52.754384 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:24:52.755623 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:24:52.755623 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application with Lock( Jul 25 21:24:52.755623 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:24:52.755623 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:24:52.755623 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:24:52.755623 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:24:52.755623 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:24:52.755623 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:24:52.755623 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:24:52.755623 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:24:52.755623 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 21:24:52.755623 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 21:24:52.755623 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 21:24:52.755623 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Jul 25 21:24:52.755623 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 448/919] 10.222.0.66 () {56 vars in 1117 bytes} [Mon Jul 25 21:24:52 2022] GET /identity/v3/services/placement => generated 90 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:24:52.764231 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12021101-c435-467f-b195-29cfef582876 None None] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:52.789236 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:52.878691 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12021101-c435-467f-b195-29cfef582876 None None] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:52.914629 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5b0ac2-bb5e-45a9-a292-da877d372088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:52.915317 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5b0ac2-bb5e-45a9-a292-da877d372088 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:52.915603 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5b0ac2-bb5e-45a9-a292-da877d372088 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:52.915877 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5b0ac2-bb5e-45a9-a292-da877d372088 None admin] PATH_INFO: `/v3/services` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:52.916551 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5b0ac2-bb5e-45a9-a292-da877d372088 None admin] RBAC: Adding query filter params (name=placement) {{(pid=87209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:24:52.916854 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5b0ac2-bb5e-45a9-a292-da877d372088 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:52.918276 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5b0ac2-bb5e-45a9-a292-da877d372088 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:52.923360 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 472/920] 10.222.0.66 () {56 vars in 1116 bytes} [Mon Jul 25 21:24:52 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:52.930175 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b13a39-515a-4ecb-9cff-5806f3462bcf None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:52.969633 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:53.044748 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b13a39-515a-4ecb-9cff-5806f3462bcf None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:53.081566 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103642a2-41b0-4761-bde4-2bfcdf3fd635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:53.082187 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103642a2-41b0-4761-bde4-2bfcdf3fd635 None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:53.082462 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103642a2-41b0-4761-bde4-2bfcdf3fd635 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:53.082736 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103642a2-41b0-4761-bde4-2bfcdf3fd635 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:53.083471 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103642a2-41b0-4761-bde4-2bfcdf3fd635 None admin] RBAC: Adding query filter params (interface=public, service_id=36a160a13f7e488b825282b5292ff78c, region_id=RegionOne) {{(pid=87210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:24:53.083774 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103642a2-41b0-4761-bde4-2bfcdf3fd635 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:53.085184 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103642a2-41b0-4761-bde4-2bfcdf3fd635 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:53.090916 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 449/921] 10.222.0.66 () {56 vars in 1251 bytes} [Mon Jul 25 21:24:52 2022] GET /identity/v3/endpoints?service_id=36a160a13f7e488b825282b5292ff78c&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:53.097856 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5b0ac2-bb5e-45a9-a292-da877d372088 None admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:53.185235 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:53.209894 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5b0ac2-bb5e-45a9-a292-da877d372088 None admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:53.245496 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49edc3d2-1538-4a05-ad1d-134a4a8c938b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:53.246035 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49edc3d2-1538-4a05-ad1d-134a4a8c938b None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:53.246315 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49edc3d2-1538-4a05-ad1d-134a4a8c938b None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:53.246587 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49edc3d2-1538-4a05-ad1d-134a4a8c938b None admin] PATH_INFO: `/v3/services` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:53.247230 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49edc3d2-1538-4a05-ad1d-134a4a8c938b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:53.248605 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49edc3d2-1538-4a05-ad1d-134a4a8c938b None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:53.255563 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 473/922] 10.222.0.66 () {56 vars in 1087 bytes} [Mon Jul 25 21:24:53 2022] GET /identity/v3/services => generated 1962 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 21:24:55.488152 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92080949-527b-4148-afc0-00d8dd46514e None None] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:55.489261 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92080949-527b-4148-afc0-00d8dd46514e None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:55.489261 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92080949-527b-4148-afc0-00d8dd46514e None None] PATH_INFO: `/` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:55.491245 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 450/923] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:24:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:24:55.496792 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c07f9e9-0733-496d-be27-d0adae4b120b None None] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:55.497285 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c07f9e9-0733-496d-be27-d0adae4b120b None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:55.497377 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c07f9e9-0733-496d-be27-d0adae4b120b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:55.517834 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.auth.core [None req-5c07f9e9-0733-496d-be27-d0adae4b120b None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:24:55.519017 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-5c07f9e9-0733-496d-be27-d0adae4b120b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:24:55.604690 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 474/924] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:24:55 2022] POST /identity/v3/auth/tokens => generated 1962 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 21:24:55.629868 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92080949-527b-4148-afc0-00d8dd46514e None None] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:55.724096 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:55.735063 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92080949-527b-4148-afc0-00d8dd46514e None None] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:55.770430 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f676fb98-7ade-4cb0-8ec8-671cb5c8e8ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:55.771003 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f676fb98-7ade-4cb0-8ec8-671cb5c8e8ac None admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:55.771280 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f676fb98-7ade-4cb0-8ec8-671cb5c8e8ac None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:55.771545 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f676fb98-7ade-4cb0-8ec8-671cb5c8e8ac None admin] PATH_INFO: `/v3/services/placement` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:55.772157 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f676fb98-7ade-4cb0-8ec8-671cb5c8e8ac None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:55.773673 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f676fb98-7ade-4cb0-8ec8-671cb5c8e8ac None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:55.782792 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application [None req-f676fb98-7ade-4cb0-8ec8-671cb5c8e8ac None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 21:24:55.782792 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:24:55.782792 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 21:24:55.782792 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 21:24:55.782792 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 21:24:55.782792 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 21:24:55.782792 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 21:24:55.782792 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 21:24:55.782792 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 21:24:55.782792 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Jul 25 21:24:55.782792 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 21:24:55.782792 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Jul 25 21:24:55.782792 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:24:55.782792 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:24:55.782792 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:24:55.782792 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:24:55.782792 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:24:55.783920 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:24:55.783920 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:24:55.783920 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:24:55.783920 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:24:55.783920 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:24:55.783920 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:24:55.783920 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 21:24:55.783920 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 21:24:55.783920 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 21:24:55.783920 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 21:24:55.783920 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:24:55.783920 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:24:55.783920 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:24:55.783920 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:24:55.783920 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:24:55.783920 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:24:55.784959 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:24:55.784959 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application with Lock( Jul 25 21:24:55.784959 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:24:55.784959 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:24:55.784959 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:24:55.784959 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:24:55.784959 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:24:55.784959 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:24:55.784959 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:24:55.784959 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:24:55.784959 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 21:24:55.784959 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 21:24:55.784959 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 21:24:55.784959 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: ERROR keystone.server.flask.application Jul 25 21:24:55.784959 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 451/925] 10.222.0.66 () {56 vars in 1117 bytes} [Mon Jul 25 21:24:55 2022] GET /identity/v3/services/placement => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:24:55.790785 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c07f9e9-0733-496d-be27-d0adae4b120b None None] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:55.876087 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:55.907700 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c07f9e9-0733-496d-be27-d0adae4b120b None None] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:55.941543 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4328ea3-9c14-4cbf-a8be-bc076f780516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:55.942183 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4328ea3-9c14-4cbf-a8be-bc076f780516 None admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:55.942460 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4328ea3-9c14-4cbf-a8be-bc076f780516 None admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:55.942730 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4328ea3-9c14-4cbf-a8be-bc076f780516 None admin] PATH_INFO: `/v3/services` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:55.943398 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4328ea3-9c14-4cbf-a8be-bc076f780516 None admin] RBAC: Adding query filter params (name=placement) {{(pid=87209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:24:55.943706 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4328ea3-9c14-4cbf-a8be-bc076f780516 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:55.945110 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4328ea3-9c14-4cbf-a8be-bc076f780516 None admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:55.950278 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 475/926] 10.222.0.66 () {56 vars in 1116 bytes} [Mon Jul 25 21:24:55 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:55.959425 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f676fb98-7ade-4cb0-8ec8-671cb5c8e8ac None admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:56.067074 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f676fb98-7ade-4cb0-8ec8-671cb5c8e8ac None admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:56.102748 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876ab1d2-adf9-4789-8368-027f65dede13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:56.103362 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876ab1d2-adf9-4789-8368-027f65dede13 None admin] REQUEST_METHOD: `POST` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:56.103642 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876ab1d2-adf9-4789-8368-027f65dede13 None admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:56.103914 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876ab1d2-adf9-4789-8368-027f65dede13 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:56.105171 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876ab1d2-adf9-4789-8368-027f65dede13 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:56.106555 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876ab1d2-adf9-4789-8368-027f65dede13 None admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:56.132593 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 452/927] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Jul 25 21:24:55 2022] POST /identity/v3/endpoints => generated 331 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 21:25:05.947420 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=30 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:06.128319 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=93,keystone:INSERT=1 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:55.940406 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037d6dca-ccbd-4629-b952-e44660c0cce8 None None] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:55.944840 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037d6dca-ccbd-4629-b952-e44660c0cce8 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:55.944840 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037d6dca-ccbd-4629-b952-e44660c0cce8 None None] PATH_INFO: `/` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:55.944840 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 476/928] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:25:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:25:55.949723 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19123d3-19e7-4612-9f2b-d80a5790d73a None None] REQUEST_METHOD: `POST` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:55.950181 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19123d3-19e7-4612-9f2b-d80a5790d73a None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:55.950181 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19123d3-19e7-4612-9f2b-d80a5790d73a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:55.970067 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.auth.core [None req-f19123d3-19e7-4612-9f2b-d80a5790d73a None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:25:55.971281 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.fernet_utils [None req-f19123d3-19e7-4612-9f2b-d80a5790d73a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:25:56.073163 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 453/929] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:25:55 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:25:56.123226 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f6c957-1b16-495d-85dd-d08c679af89e None None] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:56.123509 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f6c957-1b16-495d-85dd-d08c679af89e None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:56.123785 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f6c957-1b16-495d-85dd-d08c679af89e None None] PATH_INFO: `/` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:56.125235 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 477/930] 10.222.0.66 () {54 vars in 965 bytes} [Mon Jul 25 21:25:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:25:56.131199 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ab4c16-53f7-4e11-88eb-9d1543e712ec None None] REQUEST_METHOD: `POST` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:56.131656 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ab4c16-53f7-4e11-88eb-9d1543e712ec None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:56.131932 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ab4c16-53f7-4e11-88eb-9d1543e712ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:56.199256 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.auth.core [None req-c8ab4c16-53f7-4e11-88eb-9d1543e712ec None None] MFA Rules not processed for user `704ea1ca162d4df3ab560d910d599851`. Rule list: `[]` (Enabled: `True`). {{(pid=87210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:25:56.200608 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.fernet_utils [None req-c8ab4c16-53f7-4e11-88eb-9d1543e712ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:25:56.286456 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 454/931] 10.222.0.66 () {58 vars in 1062 bytes} [Mon Jul 25 21:25:56 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 21:25:56.296742 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f6c957-1b16-495d-85dd-d08c679af89e None None] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:56.309827 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f6c957-1b16-495d-85dd-d08c679af89e None None] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:56.314134 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953991d9-3468-4b5e-ad7e-b6ff2c165cc3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '704ea1ca162d4df3ab560d910d599851', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e36d923af474a07adb12209580f12e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:56.314647 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953991d9-3468-4b5e-ad7e-b6ff2c165cc3 service neutron] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:56.314972 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953991d9-3468-4b5e-ad7e-b6ff2c165cc3 service neutron] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:56.315128 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953991d9-3468-4b5e-ad7e-b6ff2c165cc3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:56.325637 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953991d9-3468-4b5e-ad7e-b6ff2c165cc3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:56.327031 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953991d9-3468-4b5e-ad7e-b6ff2c165cc3 service neutron] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:56.336584 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 478/932] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 25 21:25:56 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:25:58.838453 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4753a2e4-b40e-4385-b2e1-a612bc386c39 None None] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:58.839010 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4753a2e4-b40e-4385-b2e1-a612bc386c39 None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:58.839010 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4753a2e4-b40e-4385-b2e1-a612bc386c39 None None] PATH_INFO: `/` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:58.840518 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 455/933] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:25:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:25:58.845994 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8644d0f-0f28-4b80-a62b-35832975bf23 None None] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:58.846468 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8644d0f-0f28-4b80-a62b-35832975bf23 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:58.846567 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8644d0f-0f28-4b80-a62b-35832975bf23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:58.867432 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.auth.core [None req-e8644d0f-0f28-4b80-a62b-35832975bf23 None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:25:58.868634 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-e8644d0f-0f28-4b80-a62b-35832975bf23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:25:58.878101 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 479/934] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:25:58 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:25:58.919641 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4753a2e4-b40e-4385-b2e1-a612bc386c39 None None] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:58.930960 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4753a2e4-b40e-4385-b2e1-a612bc386c39 None None] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:58.934896 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feae307-34c5-4ab8-a507-64b0c0d7ac49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '704ea1ca162d4df3ab560d910d599851', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e36d923af474a07adb12209580f12e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:58.935533 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feae307-34c5-4ab8-a507-64b0c0d7ac49 service neutron] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:58.935784 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feae307-34c5-4ab8-a507-64b0c0d7ac49 service neutron] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:58.936044 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feae307-34c5-4ab8-a507-64b0c0d7ac49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:58.948997 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feae307-34c5-4ab8-a507-64b0c0d7ac49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:58.950566 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feae307-34c5-4ab8-a507-64b0c0d7ac49 service neutron] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:58.960951 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 456/935] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 25 21:25:58 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:26:01.544772 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdc18fc-95d6-434c-9bb4-e412569c158c None None] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:01.545381 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdc18fc-95d6-434c-9bb4-e412569c158c None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:01.545572 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdc18fc-95d6-434c-9bb4-e412569c158c None None] PATH_INFO: `/` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:01.546956 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 480/936] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:26:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:26:01.552360 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f7ec57-7a11-4b42-800d-3a8d4ad525e3 None None] REQUEST_METHOD: `POST` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:01.552752 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f7ec57-7a11-4b42-800d-3a8d4ad525e3 None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:01.552960 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f7ec57-7a11-4b42-800d-3a8d4ad525e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:01.594737 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.auth.core [None req-90f7ec57-7a11-4b42-800d-3a8d4ad525e3 None None] MFA Rules not processed for user `598778bbdcb54a8eac7f2dcc1a1357d8`. Rule list: `[]` (Enabled: `True`). {{(pid=87210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:26:01.595954 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.fernet_utils [None req-90f7ec57-7a11-4b42-800d-3a8d4ad525e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:26:01.638110 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:01.669297 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 457/937] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:26:01 2022] POST /identity/v3/auth/tokens => generated 2793 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:26:01.709785 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdc18fc-95d6-434c-9bb4-e412569c158c None None] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:01.721035 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdc18fc-95d6-434c-9bb4-e412569c158c None None] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:01.724391 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff98407a-04e9-4447-b771-57ab9df8a788 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '704ea1ca162d4df3ab560d910d599851', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e36d923af474a07adb12209580f12e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:01.725003 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff98407a-04e9-4447-b771-57ab9df8a788 service neutron] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:01.725317 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff98407a-04e9-4447-b771-57ab9df8a788 service neutron] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:01.725588 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff98407a-04e9-4447-b771-57ab9df8a788 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:01.734698 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff98407a-04e9-4447-b771-57ab9df8a788 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:01.736139 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff98407a-04e9-4447-b771-57ab9df8a788 service neutron] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:01.745892 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 481/938] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 25 21:26:01 2022] GET /identity/v3/auth/tokens => generated 2793 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:26:04.606524 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70261ff8-acb0-41e8-b390-d49c3b1d6b49 None None] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:04.607269 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70261ff8-acb0-41e8-b390-d49c3b1d6b49 None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:04.607269 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70261ff8-acb0-41e8-b390-d49c3b1d6b49 None None] PATH_INFO: `/` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:04.608799 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 458/939] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:26:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 21:26:04.615336 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1187dea0-aa23-4c31-b074-7fae4945778a None None] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:04.616244 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1187dea0-aa23-4c31-b074-7fae4945778a None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:04.616544 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1187dea0-aa23-4c31-b074-7fae4945778a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:04.638123 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.auth.core [None req-1187dea0-aa23-4c31-b074-7fae4945778a None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:26:04.639318 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-1187dea0-aa23-4c31-b074-7fae4945778a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:26:04.709503 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 482/940] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:26:04 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 21:26:04.754462 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70261ff8-acb0-41e8-b390-d49c3b1d6b49 None None] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:04.767019 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70261ff8-acb0-41e8-b390-d49c3b1d6b49 None None] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:04.771075 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ef1745-7235-4942-8273-1b246a7ad3b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '704ea1ca162d4df3ab560d910d599851', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e36d923af474a07adb12209580f12e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:04.771963 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ef1745-7235-4942-8273-1b246a7ad3b3 service neutron] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:04.771963 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ef1745-7235-4942-8273-1b246a7ad3b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:04.772241 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ef1745-7235-4942-8273-1b246a7ad3b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:04.782090 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ef1745-7235-4942-8273-1b246a7ad3b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:04.783540 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ef1745-7235-4942-8273-1b246a7ad3b3 service neutron] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:04.793840 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 459/941] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 25 21:26:04 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:26:07.710620 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f351946-6ac5-4145-84f7-5b3e13219837 None None] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:07.711232 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f351946-6ac5-4145-84f7-5b3e13219837 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:07.711232 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f351946-6ac5-4145-84f7-5b3e13219837 None None] PATH_INFO: `/` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:07.712758 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 483/942] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:26:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:26:07.718181 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c49a21-ed54-4a2e-922f-4cb059201fd9 None None] REQUEST_METHOD: `POST` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:07.718667 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c49a21-ed54-4a2e-922f-4cb059201fd9 None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:07.718780 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c49a21-ed54-4a2e-922f-4cb059201fd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:07.739333 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.auth.core [None req-10c49a21-ed54-4a2e-922f-4cb059201fd9 None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:26:07.740550 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.fernet_utils [None req-10c49a21-ed54-4a2e-922f-4cb059201fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:26:07.750244 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 460/943] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:26:07 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:26:07.787014 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f351946-6ac5-4145-84f7-5b3e13219837 None None] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:07.799818 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f351946-6ac5-4145-84f7-5b3e13219837 None None] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:07.803639 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba381a98-0507-48fb-989c-227111c3d267 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '704ea1ca162d4df3ab560d910d599851', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e36d923af474a07adb12209580f12e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:07.804249 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba381a98-0507-48fb-989c-227111c3d267 service neutron] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:07.804527 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba381a98-0507-48fb-989c-227111c3d267 service neutron] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:07.804793 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba381a98-0507-48fb-989c-227111c3d267 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:07.814269 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba381a98-0507-48fb-989c-227111c3d267 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:07.815695 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba381a98-0507-48fb-989c-227111c3d267 service neutron] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:07.825139 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 484/944] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 25 21:26:07 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:26:10.099685 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0d9416-77da-460a-88ea-9a7d108f1440 None None] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:10.100266 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0d9416-77da-460a-88ea-9a7d108f1440 None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:10.100266 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0d9416-77da-460a-88ea-9a7d108f1440 None None] PATH_INFO: `/` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:10.101641 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 461/945] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:26:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:26:10.106948 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8761d902-e5f4-420d-a374-c2b9084a1d4b None None] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:10.107390 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8761d902-e5f4-420d-a374-c2b9084a1d4b None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:10.107489 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8761d902-e5f4-420d-a374-c2b9084a1d4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:10.127770 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.auth.core [None req-8761d902-e5f4-420d-a374-c2b9084a1d4b None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:26:10.128979 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-8761d902-e5f4-420d-a374-c2b9084a1d4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:26:10.137738 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 485/946] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:26:10 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:26:10.189524 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8bd9b3-e073-4387-8154-25c76dc866d2 None None] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:10.189765 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8bd9b3-e073-4387-8154-25c76dc866d2 None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:10.190064 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8bd9b3-e073-4387-8154-25c76dc866d2 None None] PATH_INFO: `/` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:10.191402 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 462/947] 10.222.0.66 () {54 vars in 965 bytes} [Mon Jul 25 21:26:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:26:10.197550 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8abe619-de69-4e25-9a6a-4506fc5960d5 None None] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:10.197775 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8abe619-de69-4e25-9a6a-4506fc5960d5 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:10.198043 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8abe619-de69-4e25-9a6a-4506fc5960d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:10.218327 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.auth.core [None req-f8abe619-de69-4e25-9a6a-4506fc5960d5 None None] MFA Rules not processed for user `704ea1ca162d4df3ab560d910d599851`. Rule list: `[]` (Enabled: `True`). {{(pid=87209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:26:10.219505 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-f8abe619-de69-4e25-9a6a-4506fc5960d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:26:10.227071 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 486/948] 10.222.0.66 () {58 vars in 1062 bytes} [Mon Jul 25 21:26:10 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:26:10.236205 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8bd9b3-e073-4387-8154-25c76dc866d2 None None] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:10.248644 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8bd9b3-e073-4387-8154-25c76dc866d2 None None] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:10.252610 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b62111-bf4f-4d94-8081-a06c9eeb4b92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '704ea1ca162d4df3ab560d910d599851', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e36d923af474a07adb12209580f12e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:10.253340 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b62111-bf4f-4d94-8081-a06c9eeb4b92 service neutron] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:10.253709 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b62111-bf4f-4d94-8081-a06c9eeb4b92 service neutron] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:10.254050 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b62111-bf4f-4d94-8081-a06c9eeb4b92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:10.263615 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b62111-bf4f-4d94-8081-a06c9eeb4b92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:10.265113 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b62111-bf4f-4d94-8081-a06c9eeb4b92 service neutron] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:10.274712 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 463/949] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 25 21:26:10 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:26:12.797601 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413d4bf5-5af2-42ca-bf7f-59abfe26537f None None] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:12.798156 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413d4bf5-5af2-42ca-bf7f-59abfe26537f None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:12.798156 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413d4bf5-5af2-42ca-bf7f-59abfe26537f None None] PATH_INFO: `/` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:12.799526 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 487/950] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:26:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:26:12.804802 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e51c65d-1575-4f65-b136-58df4fb125dc None None] REQUEST_METHOD: `POST` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:12.805267 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e51c65d-1575-4f65-b136-58df4fb125dc None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:12.805514 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e51c65d-1575-4f65-b136-58df4fb125dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:12.825806 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.auth.core [None req-7e51c65d-1575-4f65-b136-58df4fb125dc None None] MFA Rules not processed for user `598778bbdcb54a8eac7f2dcc1a1357d8`. Rule list: `[]` (Enabled: `True`). {{(pid=87210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:26:12.827004 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.fernet_utils [None req-7e51c65d-1575-4f65-b136-58df4fb125dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:26:12.835394 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 464/951] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:26:12 2022] POST /identity/v3/auth/tokens => generated 2793 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:26:12.881233 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413d4bf5-5af2-42ca-bf7f-59abfe26537f None None] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:12.895645 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413d4bf5-5af2-42ca-bf7f-59abfe26537f None None] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:12.901829 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbef45d-3d51-4dc0-a10d-886e5d6034bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '704ea1ca162d4df3ab560d910d599851', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e36d923af474a07adb12209580f12e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:12.902448 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbef45d-3d51-4dc0-a10d-886e5d6034bc service neutron] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:12.902728 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbef45d-3d51-4dc0-a10d-886e5d6034bc service neutron] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:12.903001 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbef45d-3d51-4dc0-a10d-886e5d6034bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:12.912381 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbef45d-3d51-4dc0-a10d-886e5d6034bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:12.914430 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbef45d-3d51-4dc0-a10d-886e5d6034bc service neutron] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:12.924613 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 488/952] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 25 21:26:12 2022] GET /identity/v3/auth/tokens => generated 2793 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:26:15.576833 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f098c3f7-b050-4bf8-9363-b12194a26828 None None] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:15.577807 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f098c3f7-b050-4bf8-9363-b12194a26828 None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:15.578079 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f098c3f7-b050-4bf8-9363-b12194a26828 None None] PATH_INFO: `/` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:15.579570 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 465/953] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:26:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:26:15.585439 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da4e7a9-2ee1-4640-8523-2dcebc0e98d5 None None] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:15.585980 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da4e7a9-2ee1-4640-8523-2dcebc0e98d5 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:15.585980 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da4e7a9-2ee1-4640-8523-2dcebc0e98d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:15.608486 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.auth.core [None req-5da4e7a9-2ee1-4640-8523-2dcebc0e98d5 None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:26:15.609784 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-5da4e7a9-2ee1-4640-8523-2dcebc0e98d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:26:15.618318 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 489/954] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:26:15 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:26:15.656227 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f098c3f7-b050-4bf8-9363-b12194a26828 None None] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:15.669292 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f098c3f7-b050-4bf8-9363-b12194a26828 None None] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:15.674077 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6708d6-4b40-4abd-aaa0-a1f8bd56837d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '704ea1ca162d4df3ab560d910d599851', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e36d923af474a07adb12209580f12e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:15.674700 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6708d6-4b40-4abd-aaa0-a1f8bd56837d service neutron] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:15.674977 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6708d6-4b40-4abd-aaa0-a1f8bd56837d service neutron] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:15.675245 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6708d6-4b40-4abd-aaa0-a1f8bd56837d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:15.685683 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6708d6-4b40-4abd-aaa0-a1f8bd56837d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:15.687125 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6708d6-4b40-4abd-aaa0-a1f8bd56837d service neutron] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:15.696687 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 466/955] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 25 21:26:15 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:26:17.965676 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d57824-e9b4-4648-9be1-8d7b6a956e91 None None] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:17.966235 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d57824-e9b4-4648-9be1-8d7b6a956e91 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:17.966235 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d57824-e9b4-4648-9be1-8d7b6a956e91 None None] PATH_INFO: `/` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:17.967688 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 490/956] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:26:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 21:26:17.973140 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cb2ece-0e15-4c35-8b64-4502ccf622b7 None None] REQUEST_METHOD: `POST` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:17.973573 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cb2ece-0e15-4c35-8b64-4502ccf622b7 None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:17.973687 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cb2ece-0e15-4c35-8b64-4502ccf622b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:17.995941 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.auth.core [None req-a5cb2ece-0e15-4c35-8b64-4502ccf622b7 None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:26:17.997195 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.fernet_utils [None req-a5cb2ece-0e15-4c35-8b64-4502ccf622b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:26:18.006575 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 467/957] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:26:17 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:26:18.047772 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d57824-e9b4-4648-9be1-8d7b6a956e91 None None] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:18.059955 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d57824-e9b4-4648-9be1-8d7b6a956e91 None None] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:18.064390 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeb1df6-39c0-46bb-8651-3feb303c3272 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '704ea1ca162d4df3ab560d910d599851', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e36d923af474a07adb12209580f12e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:18.065006 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeb1df6-39c0-46bb-8651-3feb303c3272 service neutron] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:18.065316 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeb1df6-39c0-46bb-8651-3feb303c3272 service neutron] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:18.065581 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeb1df6-39c0-46bb-8651-3feb303c3272 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:18.075637 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaeb1df6-39c0-46bb-8651-3feb303c3272 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:18.077059 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaeb1df6-39c0-46bb-8651-3feb303c3272 service neutron] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:18.086541 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 491/958] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 25 21:26:18 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:26:20.713156 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c2212d-9d94-42c9-92b4-4b923e55068b None None] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:20.714108 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c2212d-9d94-42c9-92b4-4b923e55068b None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:20.714423 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c2212d-9d94-42c9-92b4-4b923e55068b None None] PATH_INFO: `/` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:20.716489 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 468/959] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:26:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:26:20.724287 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a1fd45-3756-43d0-a930-087d7381c0f8 None None] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:20.724710 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a1fd45-3756-43d0-a930-087d7381c0f8 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:20.724801 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a1fd45-3756-43d0-a930-087d7381c0f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:20.745368 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.auth.core [None req-55a1fd45-3756-43d0-a930-087d7381c0f8 None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:26:20.746579 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-55a1fd45-3756-43d0-a930-087d7381c0f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:26:20.754929 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 492/960] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:26:20 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 21:26:20.792961 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c2212d-9d94-42c9-92b4-4b923e55068b None None] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:20.812336 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c2212d-9d94-42c9-92b4-4b923e55068b None None] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:20.819289 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092ebe74-f827-4bec-8a67-1b07a6825d26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '704ea1ca162d4df3ab560d910d599851', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e36d923af474a07adb12209580f12e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:20.820132 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092ebe74-f827-4bec-8a67-1b07a6825d26 service neutron] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:20.820442 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092ebe74-f827-4bec-8a67-1b07a6825d26 service neutron] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:20.820740 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092ebe74-f827-4bec-8a67-1b07a6825d26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:20.831654 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092ebe74-f827-4bec-8a67-1b07a6825d26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:20.833134 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092ebe74-f827-4bec-8a67-1b07a6825d26 service neutron] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:20.844458 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 469/961] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 25 21:26:20 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:26:25.236996 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fae89d-1fba-42df-8e38-c3939aecae75 None None] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:25.237629 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fae89d-1fba-42df-8e38-c3939aecae75 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:25.237629 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fae89d-1fba-42df-8e38-c3939aecae75 None None] PATH_INFO: `/` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:25.238971 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 493/962] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:26:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:26:25.244335 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d08b50-6e90-407d-b941-325441490c45 None None] REQUEST_METHOD: `POST` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:25.244750 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d08b50-6e90-407d-b941-325441490c45 None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:25.244863 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d08b50-6e90-407d-b941-325441490c45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:25.265607 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.auth.core [None req-c7d08b50-6e90-407d-b941-325441490c45 None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:26:25.266794 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.fernet_utils [None req-c7d08b50-6e90-407d-b941-325441490c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:26:25.276070 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 470/963] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:26:25 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:26:25.316655 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fae89d-1fba-42df-8e38-c3939aecae75 None None] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:25.329318 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fae89d-1fba-42df-8e38-c3939aecae75 None None] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:25.333373 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d0265c-dc1e-4438-9661-f9f9916c23d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '704ea1ca162d4df3ab560d910d599851', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e36d923af474a07adb12209580f12e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:25.333983 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d0265c-dc1e-4438-9661-f9f9916c23d5 service neutron] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:25.334257 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d0265c-dc1e-4438-9661-f9f9916c23d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:25.334526 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d0265c-dc1e-4438-9661-f9f9916c23d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:25.344072 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d0265c-dc1e-4438-9661-f9f9916c23d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:25.345535 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d0265c-dc1e-4438-9661-f9f9916c23d5 service neutron] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:25.355076 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 494/964] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 25 21:26:25 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:26:28.239237 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c46a3f-54ec-4823-8c35-887414d59e82 None None] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:28.239758 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c46a3f-54ec-4823-8c35-887414d59e82 None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:28.239758 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c46a3f-54ec-4823-8c35-887414d59e82 None None] PATH_INFO: `/` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:28.241179 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 471/965] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:26:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:26:28.247210 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fe1e63-0b1c-425f-82fd-9dc47f52d605 None None] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:28.247695 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fe1e63-0b1c-425f-82fd-9dc47f52d605 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:28.247838 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fe1e63-0b1c-425f-82fd-9dc47f52d605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:28.256012 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=83 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:28.269814 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.auth.core [None req-c3fe1e63-0b1c-425f-82fd-9dc47f52d605 None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:26:28.271030 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-c3fe1e63-0b1c-425f-82fd-9dc47f52d605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:26:28.281190 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 495/966] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:26:28 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:26:28.321398 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c46a3f-54ec-4823-8c35-887414d59e82 None None] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:28.333569 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c46a3f-54ec-4823-8c35-887414d59e82 None None] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:28.337433 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68583ef7-0d8b-4ef5-aedd-34102865f3fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '704ea1ca162d4df3ab560d910d599851', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e36d923af474a07adb12209580f12e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:28.338045 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68583ef7-0d8b-4ef5-aedd-34102865f3fc service neutron] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:28.338323 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68583ef7-0d8b-4ef5-aedd-34102865f3fc service neutron] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:28.338592 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68583ef7-0d8b-4ef5-aedd-34102865f3fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:28.348049 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68583ef7-0d8b-4ef5-aedd-34102865f3fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:28.349532 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68583ef7-0d8b-4ef5-aedd-34102865f3fc service neutron] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:28.359983 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 472/967] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 25 21:26:28 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:26:32.633474 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2380c6e-e06f-4ebb-81cf-43f609c40f20 None None] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:32.634047 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2380c6e-e06f-4ebb-81cf-43f609c40f20 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:32.634047 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2380c6e-e06f-4ebb-81cf-43f609c40f20 None None] PATH_INFO: `/` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:32.636060 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 496/968] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:26:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:26:32.643683 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a1206d-dc33-48b4-bb79-e2985724bb44 None None] REQUEST_METHOD: `POST` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:32.644211 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a1206d-dc33-48b4-bb79-e2985724bb44 None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:32.644211 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a1206d-dc33-48b4-bb79-e2985724bb44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:32.652267 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=54 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:32.668832 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.auth.core [None req-75a1206d-dc33-48b4-bb79-e2985724bb44 None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:26:32.670680 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.fernet_utils [None req-75a1206d-dc33-48b4-bb79-e2985724bb44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:26:32.680565 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 473/969] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:26:32 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:26:32.730445 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2380c6e-e06f-4ebb-81cf-43f609c40f20 None None] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:32.743008 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2380c6e-e06f-4ebb-81cf-43f609c40f20 None None] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:32.748971 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afefcb27-ed03-4415-8f24-d0a1611e8439 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '704ea1ca162d4df3ab560d910d599851', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e36d923af474a07adb12209580f12e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:32.749642 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afefcb27-ed03-4415-8f24-d0a1611e8439 service neutron] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:32.750007 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afefcb27-ed03-4415-8f24-d0a1611e8439 service neutron] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:32.750180 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afefcb27-ed03-4415-8f24-d0a1611e8439 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:32.761578 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afefcb27-ed03-4415-8f24-d0a1611e8439 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:32.763127 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afefcb27-ed03-4415-8f24-d0a1611e8439 service neutron] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:32.774084 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 497/970] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 25 21:26:32 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:26:38.429984 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8becec88-6e1b-4636-a3e7-334123a67a73 None None] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:38.430581 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8becec88-6e1b-4636-a3e7-334123a67a73 None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:38.430581 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8becec88-6e1b-4636-a3e7-334123a67a73 None None] PATH_INFO: `/` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:38.432337 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 474/971] 10.222.0.66 () {54 vars in 921 bytes} [Mon Jul 25 21:26:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:26:38.440069 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a0eaad-5134-4e02-96a0-38eadc2896fb None None] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:38.442553 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a0eaad-5134-4e02-96a0-38eadc2896fb None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:38.449690 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a0eaad-5134-4e02-96a0-38eadc2896fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:38.509159 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.auth.core [None req-96a0eaad-5134-4e02-96a0-38eadc2896fb None None] MFA Rules not processed for user `3e0e5ab2acc3425c9d820f2027f5652b`. Rule list: `[]` (Enabled: `True`). {{(pid=87209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:26:38.513831 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-96a0eaad-5134-4e02-96a0-38eadc2896fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:26:38.600829 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 498/972] 10.222.0.66 () {58 vars in 1018 bytes} [Mon Jul 25 21:26:38 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:26:42.661369 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=2 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:43.021501 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3262f4-f357-4a1e-8929-c7e67fd43c11 None None] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:43.021760 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3262f4-f357-4a1e-8929-c7e67fd43c11 None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:43.022035 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3262f4-f357-4a1e-8929-c7e67fd43c11 None None] PATH_INFO: `/` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:43.023596 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 475/973] 10.222.0.66 () {54 vars in 921 bytes} [Mon Jul 25 21:26:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:26:43.028681 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6460ed3-0fb2-4b05-8d2e-206b8f544f18 None None] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:43.029171 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6460ed3-0fb2-4b05-8d2e-206b8f544f18 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:43.029282 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6460ed3-0fb2-4b05-8d2e-206b8f544f18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:43.050097 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.auth.core [None req-a6460ed3-0fb2-4b05-8d2e-206b8f544f18 None None] MFA Rules not processed for user `3e0e5ab2acc3425c9d820f2027f5652b`. Rule list: `[]` (Enabled: `True`). {{(pid=87209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:26:43.051341 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-a6460ed3-0fb2-4b05-8d2e-206b8f544f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:26:43.060933 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 499/974] 10.222.0.66 () {58 vars in 1018 bytes} [Mon Jul 25 21:26:43 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:26:44.546325 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdfdebd-81b6-4105-b13d-b6cf544ac82a None None] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:44.546906 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdfdebd-81b6-4105-b13d-b6cf544ac82a None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:44.546906 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdfdebd-81b6-4105-b13d-b6cf544ac82a None None] PATH_INFO: `/` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:44.548424 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 476/975] 10.222.0.66 () {54 vars in 921 bytes} [Mon Jul 25 21:26:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:26:44.553692 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e55c0d1-fd98-40e3-b341-8b3c14e6d9eb None None] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:44.554084 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e55c0d1-fd98-40e3-b341-8b3c14e6d9eb None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:44.554355 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e55c0d1-fd98-40e3-b341-8b3c14e6d9eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:44.575165 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.auth.core [None req-4e55c0d1-fd98-40e3-b341-8b3c14e6d9eb None None] MFA Rules not processed for user `3e0e5ab2acc3425c9d820f2027f5652b`. Rule list: `[]` (Enabled: `True`). {{(pid=87209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:26:44.576448 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-4e55c0d1-fd98-40e3-b341-8b3c14e6d9eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:26:44.585503 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 500/976] 10.222.0.66 () {58 vars in 1018 bytes} [Mon Jul 25 21:26:44 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:26:48.533140 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f684ec85-45f2-4da3-962e-44f2e2e3cb43 None None] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:48.533140 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f684ec85-45f2-4da3-962e-44f2e2e3cb43 None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:48.533758 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f684ec85-45f2-4da3-962e-44f2e2e3cb43 None None] PATH_INFO: `/` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:48.538811 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 477/977] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:26:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:26:48.540422 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20400b57-edea-4dcc-a290-83b69adaf311 None None] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:48.540863 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20400b57-edea-4dcc-a290-83b69adaf311 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:48.540963 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20400b57-edea-4dcc-a290-83b69adaf311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:48.561951 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.auth.core [None req-20400b57-edea-4dcc-a290-83b69adaf311 None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:26:48.563265 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-20400b57-edea-4dcc-a290-83b69adaf311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:26:48.571972 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 501/978] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:26:48 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:26:48.630602 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a19ba6-bdf7-4532-a8e5-1a0841e11583 None None] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:48.631131 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a19ba6-bdf7-4532-a8e5-1a0841e11583 None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:48.631471 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a19ba6-bdf7-4532-a8e5-1a0841e11583 None None] PATH_INFO: `/` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:48.632889 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 478/979] 10.222.0.66 () {54 vars in 962 bytes} [Mon Jul 25 21:26:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:26:48.646548 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba5e5ac-aa47-4e0a-9063-a3ad92de0345 None None] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:48.647928 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba5e5ac-aa47-4e0a-9063-a3ad92de0345 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:48.653639 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba5e5ac-aa47-4e0a-9063-a3ad92de0345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:48.707185 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.auth.core [None req-bba5e5ac-aa47-4e0a-9063-a3ad92de0345 None None] MFA Rules not processed for user `524584f0d1b64e02a467b47de395c130`. Rule list: `[]` (Enabled: `True`). {{(pid=87209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:26:48.708901 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-bba5e5ac-aa47-4e0a-9063-a3ad92de0345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:26:48.782068 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 502/980] 10.222.0.66 () {58 vars in 1059 bytes} [Mon Jul 25 21:26:48 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:26:48.790753 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a19ba6-bdf7-4532-a8e5-1a0841e11583 None None] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:48.805617 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a19ba6-bdf7-4532-a8e5-1a0841e11583 None None] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:48.812147 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23db82ad-6478-4170-857f-ca878745110a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '524584f0d1b64e02a467b47de395c130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e36d923af474a07adb12209580f12e1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:48.812776 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23db82ad-6478-4170-857f-ca878745110a service nova] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:48.813055 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23db82ad-6478-4170-857f-ca878745110a service nova] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:48.813350 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23db82ad-6478-4170-857f-ca878745110a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:48.822262 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23db82ad-6478-4170-857f-ca878745110a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:48.824153 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23db82ad-6478-4170-857f-ca878745110a service nova] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:48.833994 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 479/981] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 25 21:26:48 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:26:51.308919 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29938dca-8e58-428d-b01f-f7bac220f76e None None] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:51.309529 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29938dca-8e58-428d-b01f-f7bac220f76e None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:51.309529 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29938dca-8e58-428d-b01f-f7bac220f76e None None] PATH_INFO: `/` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:51.311203 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 503/982] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:26:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:26:51.316577 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98359f81-d36d-4966-a921-f21a94fa3cef None None] REQUEST_METHOD: `POST` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:51.317016 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98359f81-d36d-4966-a921-f21a94fa3cef None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:51.317124 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98359f81-d36d-4966-a921-f21a94fa3cef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:51.336854 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.auth.core [None req-98359f81-d36d-4966-a921-f21a94fa3cef None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:26:51.338053 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.fernet_utils [None req-98359f81-d36d-4966-a921-f21a94fa3cef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:26:51.346596 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 480/983] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:26:51 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:26:51.392991 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29938dca-8e58-428d-b01f-f7bac220f76e None None] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:51.407675 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29938dca-8e58-428d-b01f-f7bac220f76e None None] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:51.413581 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4136fe6-450f-4ee0-a0fb-53507f0062fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '524584f0d1b64e02a467b47de395c130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e36d923af474a07adb12209580f12e1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:51.414204 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4136fe6-450f-4ee0-a0fb-53507f0062fa service nova] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:51.414481 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4136fe6-450f-4ee0-a0fb-53507f0062fa service nova] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:51.414749 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4136fe6-450f-4ee0-a0fb-53507f0062fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:51.425331 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4136fe6-450f-4ee0-a0fb-53507f0062fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:51.427247 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4136fe6-450f-4ee0-a0fb-53507f0062fa service nova] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:51.431393 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:51.439515 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 504/984] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 25 21:26:51 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:26:54.025037 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0338596c-2d12-42cd-a143-6ce6eb968a44 None None] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:54.025587 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0338596c-2d12-42cd-a143-6ce6eb968a44 None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:54.025816 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0338596c-2d12-42cd-a143-6ce6eb968a44 None None] PATH_INFO: `/` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:54.027586 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 481/985] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:26:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:26:54.033130 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c180cd-1123-439e-9695-b9b53840bd83 None None] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:54.033578 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c180cd-1123-439e-9695-b9b53840bd83 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:54.033686 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c180cd-1123-439e-9695-b9b53840bd83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:54.053986 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.auth.core [None req-96c180cd-1123-439e-9695-b9b53840bd83 None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:26:54.055219 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-96c180cd-1123-439e-9695-b9b53840bd83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:26:54.063706 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 505/986] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:26:54 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:26:54.111440 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dcb2dc-4050-4bc5-9c02-62f30b976daf None None] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:54.111694 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dcb2dc-4050-4bc5-9c02-62f30b976daf None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:54.111964 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dcb2dc-4050-4bc5-9c02-62f30b976daf None None] PATH_INFO: `/` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:54.113413 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 482/987] 10.222.0.66 () {54 vars in 962 bytes} [Mon Jul 25 21:26:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:26:54.118862 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d734f3-ca0a-4c3b-91d8-fc13819a94db None None] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:54.119152 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d734f3-ca0a-4c3b-91d8-fc13819a94db None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:54.119515 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d734f3-ca0a-4c3b-91d8-fc13819a94db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:54.141110 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.auth.core [None req-81d734f3-ca0a-4c3b-91d8-fc13819a94db None None] MFA Rules not processed for user `524584f0d1b64e02a467b47de395c130`. Rule list: `[]` (Enabled: `True`). {{(pid=87209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:26:54.142337 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-81d734f3-ca0a-4c3b-91d8-fc13819a94db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:26:54.154756 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 506/988] 10.222.0.66 () {58 vars in 1059 bytes} [Mon Jul 25 21:26:54 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:26:54.168068 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dcb2dc-4050-4bc5-9c02-62f30b976daf None None] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:54.193855 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dcb2dc-4050-4bc5-9c02-62f30b976daf None None] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:54.204905 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c388c4d9-0ffd-4870-b25c-45a05ccba38e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '524584f0d1b64e02a467b47de395c130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e36d923af474a07adb12209580f12e1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:54.204905 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c388c4d9-0ffd-4870-b25c-45a05ccba38e service nova] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:54.204905 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c388c4d9-0ffd-4870-b25c-45a05ccba38e service nova] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:54.204905 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c388c4d9-0ffd-4870-b25c-45a05ccba38e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:54.213662 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c388c4d9-0ffd-4870-b25c-45a05ccba38e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:54.215398 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c388c4d9-0ffd-4870-b25c-45a05ccba38e service nova] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:54.226157 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 483/989] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 25 21:26:54 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:26:56.610785 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e43f6d-f8f6-4d3f-8c38-07f642309a93 None None] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:56.611804 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e43f6d-f8f6-4d3f-8c38-07f642309a93 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:56.612302 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e43f6d-f8f6-4d3f-8c38-07f642309a93 None None] PATH_INFO: `/` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:56.614678 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 507/990] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:26:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 21:26:56.620911 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa020e84-4d28-4205-9d52-e8e5c7b473f6 None None] REQUEST_METHOD: `POST` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:56.621509 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa020e84-4d28-4205-9d52-e8e5c7b473f6 None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:56.621509 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa020e84-4d28-4205-9d52-e8e5c7b473f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:56.645884 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.auth.core [None req-aa020e84-4d28-4205-9d52-e8e5c7b473f6 None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:26:56.647841 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.fernet_utils [None req-aa020e84-4d28-4205-9d52-e8e5c7b473f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:26:56.668558 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 484/991] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:26:56 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 21:26:56.714387 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e43f6d-f8f6-4d3f-8c38-07f642309a93 None None] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:56.730243 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e43f6d-f8f6-4d3f-8c38-07f642309a93 None None] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:56.736244 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ac22fe-670b-4639-9de6-e14f4f08ad73 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '524584f0d1b64e02a467b47de395c130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e36d923af474a07adb12209580f12e1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:56.737180 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ac22fe-670b-4639-9de6-e14f4f08ad73 service nova] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:56.737682 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ac22fe-670b-4639-9de6-e14f4f08ad73 service nova] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:56.738153 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ac22fe-670b-4639-9de6-e14f4f08ad73 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:56.747947 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ac22fe-670b-4639-9de6-e14f4f08ad73 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:56.749881 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ac22fe-670b-4639-9de6-e14f4f08ad73 service nova] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:56.760227 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 508/992] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 25 21:26:56 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:26:58.738171 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163ce3ec-3cdc-4f4c-bdbd-ebbb8d22069d None None] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:58.738791 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163ce3ec-3cdc-4f4c-bdbd-ebbb8d22069d None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:58.738791 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163ce3ec-3cdc-4f4c-bdbd-ebbb8d22069d None None] PATH_INFO: `/` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:58.740123 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 485/993] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:26:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:26:58.746132 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9886fd-3a51-4097-83bb-525f0add538c None None] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:58.746626 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9886fd-3a51-4097-83bb-525f0add538c None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:58.746755 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9886fd-3a51-4097-83bb-525f0add538c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:58.767409 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.auth.core [None req-4f9886fd-3a51-4097-83bb-525f0add538c None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:26:58.769039 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-4f9886fd-3a51-4097-83bb-525f0add538c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:26:58.787694 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 509/994] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:26:58 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:26:59.089307 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f368cc1a-437c-46e1-99e0-c487d2573fa2 None None] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:59.089307 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f368cc1a-437c-46e1-99e0-c487d2573fa2 None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:59.089307 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f368cc1a-437c-46e1-99e0-c487d2573fa2 None None] PATH_INFO: `/` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:59.091662 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 486/995] 10.222.0.66 () {54 vars in 964 bytes} [Mon Jul 25 21:26:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:26:59.095931 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bdf2af-ae63-4512-a21f-88ceb1e3859b None None] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:59.096279 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bdf2af-ae63-4512-a21f-88ceb1e3859b None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:59.096463 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bdf2af-ae63-4512-a21f-88ceb1e3859b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:59.135328 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.auth.core [None req-b4bdf2af-ae63-4512-a21f-88ceb1e3859b None None] MFA Rules not processed for user `b36a8b42b275490d8f7fbd4e16f398fa`. Rule list: `[]` (Enabled: `True`). {{(pid=87209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:26:59.137062 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-b4bdf2af-ae63-4512-a21f-88ceb1e3859b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:26:59.204083 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 510/996] 10.222.0.66 () {58 vars in 1061 bytes} [Mon Jul 25 21:26:59 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:26:59.211907 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f368cc1a-437c-46e1-99e0-c487d2573fa2 None None] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:59.223291 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f368cc1a-437c-46e1-99e0-c487d2573fa2 None None] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:59.226995 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15fd9ca-f4b7-4725-8009-7c6721909dc0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36a8b42b275490d8f7fbd4e16f398fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e36d923af474a07adb12209580f12e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:59.227610 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15fd9ca-f4b7-4725-8009-7c6721909dc0 service cinder] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:59.228697 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15fd9ca-f4b7-4725-8009-7c6721909dc0 service cinder] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:59.228697 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15fd9ca-f4b7-4725-8009-7c6721909dc0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:59.238322 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15fd9ca-f4b7-4725-8009-7c6721909dc0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:59.239789 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15fd9ca-f4b7-4725-8009-7c6721909dc0 service cinder] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:59.249705 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 487/997] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 25 21:26:59 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:26:59.435825 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3ac5c6-f29f-460b-8e4d-61484f19c54d None None] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:59.436040 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3ac5c6-f29f-460b-8e4d-61484f19c54d None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:59.436383 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3ac5c6-f29f-460b-8e4d-61484f19c54d None None] PATH_INFO: `/` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:59.437886 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 511/998] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:26:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:26:59.443035 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40abe3c-bc09-4a5b-ac9d-b614d164ee00 None None] REQUEST_METHOD: `POST` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:59.443276 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40abe3c-bc09-4a5b-ac9d-b614d164ee00 None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:59.443780 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40abe3c-bc09-4a5b-ac9d-b614d164ee00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:59.464429 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.auth.core [None req-d40abe3c-bc09-4a5b-ac9d-b614d164ee00 None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:26:59.465668 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.fernet_utils [None req-d40abe3c-bc09-4a5b-ac9d-b614d164ee00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:26:59.474309 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 488/999] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:26:59 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:26:59.524099 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3ac5c6-f29f-460b-8e4d-61484f19c54d None None] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:59.540413 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3ac5c6-f29f-460b-8e4d-61484f19c54d None None] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:59.546474 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4340cb76-3891-48d1-8750-053bdffddd85 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '524584f0d1b64e02a467b47de395c130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e36d923af474a07adb12209580f12e1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:59.547238 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4340cb76-3891-48d1-8750-053bdffddd85 service nova] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:59.547631 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4340cb76-3891-48d1-8750-053bdffddd85 service nova] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:59.548008 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4340cb76-3891-48d1-8750-053bdffddd85 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:59.558323 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4340cb76-3891-48d1-8750-053bdffddd85 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:59.560277 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4340cb76-3891-48d1-8750-053bdffddd85 service nova] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:59.574340 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 512/1000] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 25 21:26:59 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:27:01.931148 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7a4b13-32e4-4e89-9075-506fb42ed3f5 None None] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:27:01.931682 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7a4b13-32e4-4e89-9075-506fb42ed3f5 None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:27:01.931682 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7a4b13-32e4-4e89-9075-506fb42ed3f5 None None] PATH_INFO: `/` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:27:01.933241 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 489/1001] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:27:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:27:01.938546 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcc79db-3b4a-4b0c-8242-6c226206292b None None] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:27:01.938952 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcc79db-3b4a-4b0c-8242-6c226206292b None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:27:01.939229 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcc79db-3b4a-4b0c-8242-6c226206292b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:27:01.962775 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.auth.core [None req-adcc79db-3b4a-4b0c-8242-6c226206292b None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:27:01.964318 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-adcc79db-3b4a-4b0c-8242-6c226206292b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:27:01.972440 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 513/1002] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:27:01 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:27:02.017873 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7a4b13-32e4-4e89-9075-506fb42ed3f5 None None] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:27:02.032594 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7a4b13-32e4-4e89-9075-506fb42ed3f5 None None] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:27:02.038026 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e134d5d-c8a0-4eeb-b8c1-f95a0fa22329 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '524584f0d1b64e02a467b47de395c130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e36d923af474a07adb12209580f12e1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:27:02.038638 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e134d5d-c8a0-4eeb-b8c1-f95a0fa22329 service nova] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:27:02.038917 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e134d5d-c8a0-4eeb-b8c1-f95a0fa22329 service nova] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:27:02.039188 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e134d5d-c8a0-4eeb-b8c1-f95a0fa22329 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:27:02.048145 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e134d5d-c8a0-4eeb-b8c1-f95a0fa22329 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:27:02.049777 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e134d5d-c8a0-4eeb-b8c1-f95a0fa22329 service nova] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:27:02.059442 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 490/1003] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 25 21:27:02 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:27:04.334351 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11ddf53-7244-4952-a2de-553ade1e4750 None None] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:27:04.334884 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11ddf53-7244-4952-a2de-553ade1e4750 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:27:04.334884 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11ddf53-7244-4952-a2de-553ade1e4750 None None] PATH_INFO: `/` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:27:04.336323 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 514/1004] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:27:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:27:04.341820 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf09ce03-1663-4999-ad14-4df1ae46d95e None None] REQUEST_METHOD: `POST` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:27:04.342217 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf09ce03-1663-4999-ad14-4df1ae46d95e None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:27:04.342358 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf09ce03-1663-4999-ad14-4df1ae46d95e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:27:04.362571 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.auth.core [None req-cf09ce03-1663-4999-ad14-4df1ae46d95e None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:27:04.363762 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.fernet_utils [None req-cf09ce03-1663-4999-ad14-4df1ae46d95e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:27:04.372096 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 491/1005] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:27:04 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:27:04.417487 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11ddf53-7244-4952-a2de-553ade1e4750 None None] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:27:04.431729 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11ddf53-7244-4952-a2de-553ade1e4750 None None] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:27:04.437147 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1e12d0-3d4f-4516-8650-d2d0dfce12c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '524584f0d1b64e02a467b47de395c130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e36d923af474a07adb12209580f12e1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:27:04.437847 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1e12d0-3d4f-4516-8650-d2d0dfce12c5 service nova] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:27:04.438189 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1e12d0-3d4f-4516-8650-d2d0dfce12c5 service nova] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:27:04.438530 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1e12d0-3d4f-4516-8650-d2d0dfce12c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:27:04.447839 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1e12d0-3d4f-4516-8650-d2d0dfce12c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:27:04.449605 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1e12d0-3d4f-4516-8650-d2d0dfce12c5 service nova] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:27:04.459742 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 515/1006] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 25 21:27:04 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:27:06.751940 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31555aaf-bf93-4ed1-923c-f0d4893cff92 None None] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:27:06.752525 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31555aaf-bf93-4ed1-923c-f0d4893cff92 None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:27:06.752525 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31555aaf-bf93-4ed1-923c-f0d4893cff92 None None] PATH_INFO: `/` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:27:06.753764 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 492/1007] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:27:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:27:06.759062 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e898e9ee-2bf0-4e74-955e-6503353bc8f5 None None] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:27:06.759521 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e898e9ee-2bf0-4e74-955e-6503353bc8f5 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:27:06.759626 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e898e9ee-2bf0-4e74-955e-6503353bc8f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:27:06.780762 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.auth.core [None req-e898e9ee-2bf0-4e74-955e-6503353bc8f5 None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:27:06.782011 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-e898e9ee-2bf0-4e74-955e-6503353bc8f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:27:06.790862 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 516/1008] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:27:06 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:27:06.836055 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31555aaf-bf93-4ed1-923c-f0d4893cff92 None None] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:27:06.850519 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31555aaf-bf93-4ed1-923c-f0d4893cff92 None None] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:27:06.856453 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bf9db9-7a55-415a-b6b6-3e8b8c78f636 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '524584f0d1b64e02a467b47de395c130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e36d923af474a07adb12209580f12e1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:27:06.857234 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bf9db9-7a55-415a-b6b6-3e8b8c78f636 service nova] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:27:06.857516 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bf9db9-7a55-415a-b6b6-3e8b8c78f636 service nova] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:27:06.857789 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bf9db9-7a55-415a-b6b6-3e8b8c78f636 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:27:06.866911 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bf9db9-7a55-415a-b6b6-3e8b8c78f636 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:27:06.868625 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bf9db9-7a55-415a-b6b6-3e8b8c78f636 service nova] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:27:06.879349 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 493/1009] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 25 21:27:06 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:27:09.225162 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92faf709-8c57-48af-8885-b96216edae8b None None] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:27:09.225836 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92faf709-8c57-48af-8885-b96216edae8b None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:27:09.225836 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92faf709-8c57-48af-8885-b96216edae8b None None] PATH_INFO: `/` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:27:09.227041 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 517/1010] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:27:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:27:09.232536 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6af7bf-df30-4c78-90f4-5868e5f2552d None None] REQUEST_METHOD: `POST` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:27:09.233011 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6af7bf-df30-4c78-90f4-5868e5f2552d None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:27:09.233186 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6af7bf-df30-4c78-90f4-5868e5f2552d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:27:09.254333 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.auth.core [None req-5f6af7bf-df30-4c78-90f4-5868e5f2552d None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:27:09.255574 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.fernet_utils [None req-5f6af7bf-df30-4c78-90f4-5868e5f2552d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:27:09.266873 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 494/1011] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:27:09 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:27:09.321151 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92faf709-8c57-48af-8885-b96216edae8b None None] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:27:09.338308 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92faf709-8c57-48af-8885-b96216edae8b None None] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:27:09.344714 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0454c315-95af-4232-8b2a-0854bf007311 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '524584f0d1b64e02a467b47de395c130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e36d923af474a07adb12209580f12e1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:27:09.345696 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0454c315-95af-4232-8b2a-0854bf007311 service nova] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:27:09.346052 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0454c315-95af-4232-8b2a-0854bf007311 service nova] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:27:09.346425 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0454c315-95af-4232-8b2a-0854bf007311 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:27:09.357855 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0454c315-95af-4232-8b2a-0854bf007311 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:27:09.359949 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0454c315-95af-4232-8b2a-0854bf007311 service nova] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:27:09.372102 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 518/1012] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 25 21:27:09 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:27:12.048236 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb2002c-4153-4b5c-a5e5-633bf72b3bfe None None] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:27:12.048903 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb2002c-4153-4b5c-a5e5-633bf72b3bfe None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:27:12.048903 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb2002c-4153-4b5c-a5e5-633bf72b3bfe None None] PATH_INFO: `/` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:27:12.050748 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 495/1013] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:27:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:27:12.058012 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084e15b2-2e04-4fc9-870f-702121475ca8 None None] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:27:12.058573 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084e15b2-2e04-4fc9-870f-702121475ca8 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:27:12.058685 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084e15b2-2e04-4fc9-870f-702121475ca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:27:12.085662 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.auth.core [None req-084e15b2-2e04-4fc9-870f-702121475ca8 None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:27:12.087257 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-084e15b2-2e04-4fc9-870f-702121475ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:27:12.098622 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 519/1014] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:27:12 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:27:12.155424 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb2002c-4153-4b5c-a5e5-633bf72b3bfe None None] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:27:12.172608 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb2002c-4153-4b5c-a5e5-633bf72b3bfe None None] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:27:12.179006 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e6192b-40a3-4e2e-8c7c-ab9c91578b9f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '524584f0d1b64e02a467b47de395c130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e36d923af474a07adb12209580f12e1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:27:12.179790 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e6192b-40a3-4e2e-8c7c-ab9c91578b9f service nova] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:27:12.180136 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e6192b-40a3-4e2e-8c7c-ab9c91578b9f service nova] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:27:12.180468 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e6192b-40a3-4e2e-8c7c-ab9c91578b9f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:27:12.191509 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e6192b-40a3-4e2e-8c7c-ab9c91578b9f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:27:12.193846 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e6192b-40a3-4e2e-8c7c-ab9c91578b9f service nova] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:27:12.206781 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 496/1015] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 25 21:27:12 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:27:14.998840 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcc4182-502a-45e7-b64f-ba7495a9faa0 None None] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:27:14.999549 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcc4182-502a-45e7-b64f-ba7495a9faa0 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:27:14.999549 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcc4182-502a-45e7-b64f-ba7495a9faa0 None None] PATH_INFO: `/` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:27:15.000994 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 520/1016] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:27:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:27:15.006392 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b128b3b-e12b-4288-ae9c-9f889a18729b None None] REQUEST_METHOD: `POST` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:27:15.006894 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b128b3b-e12b-4288-ae9c-9f889a18729b None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:27:15.006985 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b128b3b-e12b-4288-ae9c-9f889a18729b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:27:15.015426 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=52 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:27:15.029369 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.auth.core [None req-2b128b3b-e12b-4288-ae9c-9f889a18729b None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:27:15.030601 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.fernet_utils [None req-2b128b3b-e12b-4288-ae9c-9f889a18729b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:27:15.040142 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 497/1017] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:27:15 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 21:27:15.079755 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f946276c-c851-4bf6-9a9d-5057091fe9b6 None None] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:27:15.080048 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f946276c-c851-4bf6-9a9d-5057091fe9b6 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:27:15.080326 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f946276c-c851-4bf6-9a9d-5057091fe9b6 None None] PATH_INFO: `/` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:27:15.081900 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 521/1018] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:27:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:27:15.086442 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b128b3b-e12b-4288-ae9c-9f889a18729b None None] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:27:15.086792 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce7d279-2072-450d-9bbe-e6c58b9997d9 None None] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:27:15.087203 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce7d279-2072-450d-9bbe-e6c58b9997d9 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:27:15.087485 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce7d279-2072-450d-9bbe-e6c58b9997d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:27:15.099151 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b128b3b-e12b-4288-ae9c-9f889a18729b None None] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:27:15.105116 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af51c3d8-e815-42f8-a695-40ac7b3e1a28 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '524584f0d1b64e02a467b47de395c130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e36d923af474a07adb12209580f12e1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:27:15.105757 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af51c3d8-e815-42f8-a695-40ac7b3e1a28 service nova] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:27:15.106035 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af51c3d8-e815-42f8-a695-40ac7b3e1a28 service nova] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:27:15.106308 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af51c3d8-e815-42f8-a695-40ac7b3e1a28 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:27:15.106632 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.auth.core [None req-3ce7d279-2072-450d-9bbe-e6c58b9997d9 None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:27:15.107840 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-3ce7d279-2072-450d-9bbe-e6c58b9997d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:27:15.115395 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af51c3d8-e815-42f8-a695-40ac7b3e1a28 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:27:15.115684 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 522/1019] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:27:15 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 21:27:15.117007 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af51c3d8-e815-42f8-a695-40ac7b3e1a28 service nova] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:27:15.126826 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 498/1020] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 25 21:27:15 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 21:27:15.181219 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9be1b0-1410-46b7-b958-19ac2769d492 None None] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:27:15.182015 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9be1b0-1410-46b7-b958-19ac2769d492 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:27:15.182459 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9be1b0-1410-46b7-b958-19ac2769d492 None None] PATH_INFO: `/` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:27:15.184075 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 523/1021] 10.222.0.66 () {54 vars in 966 bytes} [Mon Jul 25 21:27:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:27:15.190624 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0e80fd-acf9-4e17-a49f-81e65316c7bc None None] REQUEST_METHOD: `POST` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:27:15.190955 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0e80fd-acf9-4e17-a49f-81e65316c7bc None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:27:15.191231 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0e80fd-acf9-4e17-a49f-81e65316c7bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:27:15.238066 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.auth.core [None req-5d0e80fd-acf9-4e17-a49f-81e65316c7bc None None] MFA Rules not processed for user `1b47561e7cd048f79518db147de16c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=87210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:27:15.239310 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.fernet_utils [None req-5d0e80fd-acf9-4e17-a49f-81e65316c7bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:27:15.310521 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 499/1022] 10.222.0.66 () {58 vars in 1063 bytes} [Mon Jul 25 21:27:15 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:27:15.318558 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9be1b0-1410-46b7-b958-19ac2769d492 None None] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:27:15.330974 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9be1b0-1410-46b7-b958-19ac2769d492 None None] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:27:15.334978 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e679e10d-2659-434c-be1e-d3471068eb67 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b47561e7cd048f79518db147de16c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e36d923af474a07adb12209580f12e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:27:15.335621 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e679e10d-2659-434c-be1e-d3471068eb67 service glance] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:27:15.335894 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e679e10d-2659-434c-be1e-d3471068eb67 service glance] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:27:15.336164 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e679e10d-2659-434c-be1e-d3471068eb67 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:27:15.347097 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e679e10d-2659-434c-be1e-d3471068eb67 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:27:15.348562 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e679e10d-2659-434c-be1e-d3471068eb67 service glance] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:27:15.359771 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 524/1023] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 25 21:27:15 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:27:17.444496 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab4873d-24fd-4ff9-95ea-1c5ac74f3625 None None] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:27:17.445379 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab4873d-24fd-4ff9-95ea-1c5ac74f3625 None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:27:17.445379 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab4873d-24fd-4ff9-95ea-1c5ac74f3625 None None] PATH_INFO: `/` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:27:17.446442 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 500/1024] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:27:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 21:27:17.452216 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce46318-b29f-47d1-a307-121880799a27 None None] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:27:17.452783 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce46318-b29f-47d1-a307-121880799a27 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:27:17.452783 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce46318-b29f-47d1-a307-121880799a27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:27:17.473757 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.auth.core [None req-2ce46318-b29f-47d1-a307-121880799a27 None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:27:17.474974 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-2ce46318-b29f-47d1-a307-121880799a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:27:17.483471 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 525/1025] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:27:17 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:27:17.530757 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab4873d-24fd-4ff9-95ea-1c5ac74f3625 None None] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:27:17.548619 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab4873d-24fd-4ff9-95ea-1c5ac74f3625 None None] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:27:17.554103 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298a1698-a9a9-4ef3-9030-195168c421cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '524584f0d1b64e02a467b47de395c130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e36d923af474a07adb12209580f12e1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:27:17.554806 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298a1698-a9a9-4ef3-9030-195168c421cd service nova] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:27:17.555167 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298a1698-a9a9-4ef3-9030-195168c421cd service nova] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:27:17.555506 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298a1698-a9a9-4ef3-9030-195168c421cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:27:17.567939 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298a1698-a9a9-4ef3-9030-195168c421cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:27:17.569785 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298a1698-a9a9-4ef3-9030-195168c421cd service nova] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:27:17.580519 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 501/1026] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 25 21:27:17 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:27:27.467778 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=88 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:27:27.576106 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=47 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:27:30.850509 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11a3a42-1e44-47c4-bcf6-0574efc98454 None None] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:27:30.851243 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11a3a42-1e44-47c4-bcf6-0574efc98454 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:27:30.851243 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11a3a42-1e44-47c4-bcf6-0574efc98454 None None] PATH_INFO: `/` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:27:30.852488 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 526/1027] 10.222.0.66 () {54 vars in 918 bytes} [Mon Jul 25 21:27:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:27:30.858058 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4270e36-f11d-4c84-8323-356bb2821e5c None None] REQUEST_METHOD: `POST` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:27:30.858566 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4270e36-f11d-4c84-8323-356bb2821e5c None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:27:30.858566 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4270e36-f11d-4c84-8323-356bb2821e5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:27:30.879748 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.auth.core [None req-c4270e36-f11d-4c84-8323-356bb2821e5c None None] MFA Rules not processed for user `3e0e5ab2acc3425c9d820f2027f5652b`. Rule list: `[]` (Enabled: `True`). {{(pid=87210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:27:30.880945 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.fernet_utils [None req-c4270e36-f11d-4c84-8323-356bb2821e5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:27:30.890289 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 502/1028] 10.222.0.66 () {58 vars in 1015 bytes} [Mon Jul 25 21:27:30 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:27:30.904849 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f863cfa0-7a31-4964-a98c-62a22170b3b7 None None] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:27:30.905169 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f863cfa0-7a31-4964-a98c-62a22170b3b7 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:27:30.905444 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f863cfa0-7a31-4964-a98c-62a22170b3b7 None None] PATH_INFO: `/` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:27:30.906804 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 527/1029] 10.222.0.66 () {54 vars in 918 bytes} [Mon Jul 25 21:27:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:27:30.911866 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0a80ab-4b4e-4fd2-8b7a-b1df185839be None None] REQUEST_METHOD: `POST` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:27:30.912152 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0a80ab-4b4e-4fd2-8b7a-b1df185839be None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:27:30.912427 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0a80ab-4b4e-4fd2-8b7a-b1df185839be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:27:30.932358 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.auth.core [None req-7e0a80ab-4b4e-4fd2-8b7a-b1df185839be None None] MFA Rules not processed for user `524584f0d1b64e02a467b47de395c130`. Rule list: `[]` (Enabled: `True`). {{(pid=87210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:27:30.933599 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.fernet_utils [None req-7e0a80ab-4b4e-4fd2-8b7a-b1df185839be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:27:30.947952 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 503/1030] 10.222.0.66 () {58 vars in 1015 bytes} [Mon Jul 25 21:27:30 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:27:33.647522 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d51c958-c999-4e43-8301-27b2ffaa34b2 None None] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:27:33.648131 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d51c958-c999-4e43-8301-27b2ffaa34b2 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:27:33.648131 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d51c958-c999-4e43-8301-27b2ffaa34b2 None None] PATH_INFO: `/` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:27:33.649509 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 528/1031] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 21:27:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:27:33.656332 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0717237c-e480-444f-9f83-60719c10dd5a None None] REQUEST_METHOD: `POST` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:27:33.656786 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0717237c-e480-444f-9f83-60719c10dd5a None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:27:33.656893 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0717237c-e480-444f-9f83-60719c10dd5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:27:33.677760 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.auth.core [None req-0717237c-e480-444f-9f83-60719c10dd5a None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:27:33.678951 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.fernet_utils [None req-0717237c-e480-444f-9f83-60719c10dd5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:27:33.686833 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 504/1032] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 21:27:33 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:27:33.736749 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d51c958-c999-4e43-8301-27b2ffaa34b2 None None] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:27:33.758599 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d51c958-c999-4e43-8301-27b2ffaa34b2 None None] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:27:33.764040 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00d7de8-e956-42cb-ad10-5c2ddcd4c75a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '524584f0d1b64e02a467b47de395c130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e36d923af474a07adb12209580f12e1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:27:33.764654 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00d7de8-e956-42cb-ad10-5c2ddcd4c75a service nova] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:27:33.764934 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00d7de8-e956-42cb-ad10-5c2ddcd4c75a service nova] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:27:33.765290 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00d7de8-e956-42cb-ad10-5c2ddcd4c75a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:27:33.773639 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00d7de8-e956-42cb-ad10-5c2ddcd4c75a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:27:33.775284 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00d7de8-e956-42cb-ad10-5c2ddcd4c75a service nova] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:27:33.784690 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 529/1033] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 25 21:27:33 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:27:34.850558 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e33c3be-043b-41e3-b853-3196ec1e5eef None None] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:27:34.851159 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e33c3be-043b-41e3-b853-3196ec1e5eef None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:27:34.851159 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e33c3be-043b-41e3-b853-3196ec1e5eef None None] PATH_INFO: `/` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:27:34.852763 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 505/1034] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 21:27:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:27:34.859005 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da77530-666b-4b80-8835-d405330e3782 None None] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:27:34.859491 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da77530-666b-4b80-8835-d405330e3782 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:27:34.859595 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da77530-666b-4b80-8835-d405330e3782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:27:34.886495 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.auth.core [None req-0da77530-666b-4b80-8835-d405330e3782 None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:27:34.887747 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-0da77530-666b-4b80-8835-d405330e3782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:27:34.899211 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 530/1035] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 21:27:34 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:27:35.174330 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e33c3be-043b-41e3-b853-3196ec1e5eef None None] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:27:35.198554 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e33c3be-043b-41e3-b853-3196ec1e5eef None None] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:27:35.204463 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aceb920-977e-4482-adca-3afbafabcdba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '524584f0d1b64e02a467b47de395c130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e36d923af474a07adb12209580f12e1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:27:35.205097 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aceb920-977e-4482-adca-3afbafabcdba service nova] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:27:35.205397 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aceb920-977e-4482-adca-3afbafabcdba service nova] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:27:35.205668 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aceb920-977e-4482-adca-3afbafabcdba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:27:35.215457 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aceb920-977e-4482-adca-3afbafabcdba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:27:35.217072 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aceb920-977e-4482-adca-3afbafabcdba service nova] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:27:35.226770 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 506/1036] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 25 21:27:35 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:27:36.146514 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29acef82-446d-487d-810a-01cf17b6a7cd None None] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:27:36.147421 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29acef82-446d-487d-810a-01cf17b6a7cd None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:27:36.147421 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29acef82-446d-487d-810a-01cf17b6a7cd None None] PATH_INFO: `/` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:27:36.149583 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 531/1037] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 21:27:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:27:36.155530 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f961c489-4d95-495b-bda9-5f85e2651f21 None None] REQUEST_METHOD: `POST` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:27:36.156009 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f961c489-4d95-495b-bda9-5f85e2651f21 None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:27:36.156108 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f961c489-4d95-495b-bda9-5f85e2651f21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:27:36.185398 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.auth.core [None req-f961c489-4d95-495b-bda9-5f85e2651f21 None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:27:36.186616 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.fernet_utils [None req-f961c489-4d95-495b-bda9-5f85e2651f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:27:36.195659 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 507/1038] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 21:27:36 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:27:36.352119 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29acef82-446d-487d-810a-01cf17b6a7cd None None] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:27:36.373727 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29acef82-446d-487d-810a-01cf17b6a7cd None None] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:27:36.383511 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfafb720-4af0-49de-bfa1-23b15bebd845 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '524584f0d1b64e02a467b47de395c130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e36d923af474a07adb12209580f12e1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:27:36.384305 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfafb720-4af0-49de-bfa1-23b15bebd845 service nova] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:27:36.385170 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfafb720-4af0-49de-bfa1-23b15bebd845 service nova] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:27:36.385573 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfafb720-4af0-49de-bfa1-23b15bebd845 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:27:36.398855 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfafb720-4af0-49de-bfa1-23b15bebd845 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:27:36.401012 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfafb720-4af0-49de-bfa1-23b15bebd845 service nova] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:27:36.411230 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 532/1039] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 25 21:27:36 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:27:37.290308 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f236fda-7dda-439e-9366-0c2d1be89b9b None None] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:27:37.291158 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f236fda-7dda-439e-9366-0c2d1be89b9b None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:27:37.291330 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f236fda-7dda-439e-9366-0c2d1be89b9b None None] PATH_INFO: `/` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:27:37.292707 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 508/1040] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 21:27:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:27:37.298435 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3151bf0-e069-4710-afd2-2d3b7beac68a None None] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:27:37.298859 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3151bf0-e069-4710-afd2-2d3b7beac68a None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:27:37.298961 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3151bf0-e069-4710-afd2-2d3b7beac68a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:27:37.319544 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.auth.core [None req-a3151bf0-e069-4710-afd2-2d3b7beac68a None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:27:37.320735 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-a3151bf0-e069-4710-afd2-2d3b7beac68a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:27:37.330193 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 533/1041] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 21:27:37 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:27:37.493429 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f236fda-7dda-439e-9366-0c2d1be89b9b None None] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:27:37.512969 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f236fda-7dda-439e-9366-0c2d1be89b9b None None] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:27:37.519138 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1795665-ccda-40bf-bb76-8d5ae526be86 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '524584f0d1b64e02a467b47de395c130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e36d923af474a07adb12209580f12e1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:27:37.519722 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1795665-ccda-40bf-bb76-8d5ae526be86 service nova] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:27:37.519995 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1795665-ccda-40bf-bb76-8d5ae526be86 service nova] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:27:37.520270 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1795665-ccda-40bf-bb76-8d5ae526be86 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:27:37.528994 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1795665-ccda-40bf-bb76-8d5ae526be86 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:27:37.530629 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1795665-ccda-40bf-bb76-8d5ae526be86 service nova] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:27:37.541506 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 509/1042] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 25 21:27:37 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:27:38.446491 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84c481b-6129-44fa-9967-e653f37eed9e None None] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:27:38.447126 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84c481b-6129-44fa-9967-e653f37eed9e None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:27:38.447126 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84c481b-6129-44fa-9967-e653f37eed9e None None] PATH_INFO: `/` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:27:38.449049 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 534/1043] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 21:27:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:27:38.457263 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665a25ef-d012-4785-b066-f158571cff84 None None] REQUEST_METHOD: `POST` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:27:38.457263 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665a25ef-d012-4785-b066-f158571cff84 None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:27:38.457263 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665a25ef-d012-4785-b066-f158571cff84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:27:38.475006 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.auth.core [None req-665a25ef-d012-4785-b066-f158571cff84 None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:27:38.476228 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.fernet_utils [None req-665a25ef-d012-4785-b066-f158571cff84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:27:38.484011 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 510/1044] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 21:27:38 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:27:38.643061 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84c481b-6129-44fa-9967-e653f37eed9e None None] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:27:38.660820 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84c481b-6129-44fa-9967-e653f37eed9e None None] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:27:38.667844 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd225dd-ae17-467d-b9e3-5746d0e495a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '524584f0d1b64e02a467b47de395c130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e36d923af474a07adb12209580f12e1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:27:38.668531 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd225dd-ae17-467d-b9e3-5746d0e495a7 service nova] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:27:38.668784 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd225dd-ae17-467d-b9e3-5746d0e495a7 service nova] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:27:38.669161 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd225dd-ae17-467d-b9e3-5746d0e495a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:27:38.678272 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd225dd-ae17-467d-b9e3-5746d0e495a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:27:38.679883 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd225dd-ae17-467d-b9e3-5746d0e495a7 service nova] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:27:38.690875 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 535/1045] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 25 21:27:38 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:27:39.511146 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baf2c04-5932-4554-ac9f-2b8ebeb4bfe6 None None] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:27:39.511981 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baf2c04-5932-4554-ac9f-2b8ebeb4bfe6 None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:27:39.511981 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baf2c04-5932-4554-ac9f-2b8ebeb4bfe6 None None] PATH_INFO: `/` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:27:39.514061 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 511/1046] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 21:27:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:27:39.519996 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9fea91-2f1c-4356-adec-833e11e0cb86 None None] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:27:39.520438 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9fea91-2f1c-4356-adec-833e11e0cb86 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:27:39.520547 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9fea91-2f1c-4356-adec-833e11e0cb86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:27:39.549556 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.auth.core [None req-4e9fea91-2f1c-4356-adec-833e11e0cb86 None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:27:39.550787 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-4e9fea91-2f1c-4356-adec-833e11e0cb86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:27:39.559749 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 536/1047] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 21:27:39 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:27:39.723051 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baf2c04-5932-4554-ac9f-2b8ebeb4bfe6 None None] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:27:39.747058 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baf2c04-5932-4554-ac9f-2b8ebeb4bfe6 None None] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:27:39.757006 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce33729-c40a-4446-a87d-c45f5f42f70a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '524584f0d1b64e02a467b47de395c130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e36d923af474a07adb12209580f12e1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:27:39.757960 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce33729-c40a-4446-a87d-c45f5f42f70a service nova] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:27:39.758325 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce33729-c40a-4446-a87d-c45f5f42f70a service nova] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:27:39.758662 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce33729-c40a-4446-a87d-c45f5f42f70a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:27:39.768580 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce33729-c40a-4446-a87d-c45f5f42f70a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:27:39.770136 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce33729-c40a-4446-a87d-c45f5f42f70a service nova] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:27:39.780442 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 512/1048] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 25 21:27:39 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:27:40.632460 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca17b94-e158-4053-bf0b-34996397196d None None] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:27:40.633567 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca17b94-e158-4053-bf0b-34996397196d None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:27:40.633843 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca17b94-e158-4053-bf0b-34996397196d None None] PATH_INFO: `/` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:27:40.635714 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 537/1049] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 21:27:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:27:40.642015 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9e0ef5-4bc4-4685-8e03-587da230b11f None None] REQUEST_METHOD: `POST` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:27:40.642690 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9e0ef5-4bc4-4685-8e03-587da230b11f None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:27:40.642978 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9e0ef5-4bc4-4685-8e03-587da230b11f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:27:40.667581 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.auth.core [None req-6a9e0ef5-4bc4-4685-8e03-587da230b11f None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:27:40.668791 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.fernet_utils [None req-6a9e0ef5-4bc4-4685-8e03-587da230b11f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:27:40.678452 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 513/1050] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 21:27:40 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:27:40.852393 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca17b94-e158-4053-bf0b-34996397196d None None] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:27:40.873502 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca17b94-e158-4053-bf0b-34996397196d None None] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:27:40.879280 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd07d7bc-52d2-40a1-aac5-dff8de9673ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '524584f0d1b64e02a467b47de395c130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e36d923af474a07adb12209580f12e1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:27:40.879900 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd07d7bc-52d2-40a1-aac5-dff8de9673ab service nova] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:27:40.880179 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd07d7bc-52d2-40a1-aac5-dff8de9673ab service nova] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:27:40.880451 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd07d7bc-52d2-40a1-aac5-dff8de9673ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:27:40.889724 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd07d7bc-52d2-40a1-aac5-dff8de9673ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:27:40.891358 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd07d7bc-52d2-40a1-aac5-dff8de9673ab service nova] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:27:40.901563 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 538/1051] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 25 21:27:40 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:27:41.714636 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92d5bd2-40b8-4a32-aff7-ee1221676e6b None None] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:27:41.715545 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92d5bd2-40b8-4a32-aff7-ee1221676e6b None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:27:41.715545 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92d5bd2-40b8-4a32-aff7-ee1221676e6b None None] PATH_INFO: `/` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:27:41.717799 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 514/1052] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 21:27:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:27:41.723704 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca52cfd-3d3a-4f2c-9f93-7b2c6ebbe036 None None] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:27:41.724145 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca52cfd-3d3a-4f2c-9f93-7b2c6ebbe036 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:27:41.724285 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca52cfd-3d3a-4f2c-9f93-7b2c6ebbe036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:27:41.746558 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.auth.core [None req-dca52cfd-3d3a-4f2c-9f93-7b2c6ebbe036 None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:27:41.747771 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-dca52cfd-3d3a-4f2c-9f93-7b2c6ebbe036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:27:41.756098 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 539/1053] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 21:27:41 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:27:41.915440 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92d5bd2-40b8-4a32-aff7-ee1221676e6b None None] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:27:41.939509 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92d5bd2-40b8-4a32-aff7-ee1221676e6b None None] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:27:41.946535 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc68319-d8b9-475b-91ac-bf7a22c98d32 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '524584f0d1b64e02a467b47de395c130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e36d923af474a07adb12209580f12e1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:27:41.947366 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc68319-d8b9-475b-91ac-bf7a22c98d32 service nova] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:27:41.947912 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc68319-d8b9-475b-91ac-bf7a22c98d32 service nova] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:27:41.948112 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc68319-d8b9-475b-91ac-bf7a22c98d32 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:27:41.957215 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc68319-d8b9-475b-91ac-bf7a22c98d32 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:27:41.958842 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc68319-d8b9-475b-91ac-bf7a22c98d32 service nova] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:27:41.968916 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 515/1054] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 25 21:27:41 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:27:42.771190 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001fc3f5-e3f9-4ec8-8029-fd09d7238f43 None None] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:27:42.771776 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001fc3f5-e3f9-4ec8-8029-fd09d7238f43 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:27:42.771776 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001fc3f5-e3f9-4ec8-8029-fd09d7238f43 None None] PATH_INFO: `/` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:27:42.772990 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 540/1055] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 21:27:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:27:42.779235 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c887727-fd51-4b66-a503-1adadf25a966 None None] REQUEST_METHOD: `POST` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:27:42.779942 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c887727-fd51-4b66-a503-1adadf25a966 None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:27:42.780040 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c887727-fd51-4b66-a503-1adadf25a966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:27:42.810872 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.auth.core [None req-4c887727-fd51-4b66-a503-1adadf25a966 None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:27:42.812076 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.fernet_utils [None req-4c887727-fd51-4b66-a503-1adadf25a966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:27:42.820276 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 516/1056] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 21:27:42 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:27:42.975156 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001fc3f5-e3f9-4ec8-8029-fd09d7238f43 None None] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:27:42.990724 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001fc3f5-e3f9-4ec8-8029-fd09d7238f43 None None] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:27:42.997061 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21182b83-5502-4b48-aa97-4255eac268ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '524584f0d1b64e02a467b47de395c130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e36d923af474a07adb12209580f12e1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:27:42.997701 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21182b83-5502-4b48-aa97-4255eac268ac service nova] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:27:42.997972 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21182b83-5502-4b48-aa97-4255eac268ac service nova] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:27:42.998244 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21182b83-5502-4b48-aa97-4255eac268ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:27:43.006570 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21182b83-5502-4b48-aa97-4255eac268ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:27:43.008153 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21182b83-5502-4b48-aa97-4255eac268ac service nova] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:27:43.018017 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 541/1057] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 25 21:27:42 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:27:45.111077 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25dab47-0f05-4462-a2a9-037c0ecadab6 None None] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:27:45.111935 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25dab47-0f05-4462-a2a9-037c0ecadab6 None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:27:45.111935 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25dab47-0f05-4462-a2a9-037c0ecadab6 None None] PATH_INFO: `/` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:27:45.114292 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 517/1058] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 21:27:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:27:45.122222 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4ddccc-8aa2-4e60-8ee3-cc86d20a3f93 None None] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:27:45.122629 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4ddccc-8aa2-4e60-8ee3-cc86d20a3f93 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:27:45.122798 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4ddccc-8aa2-4e60-8ee3-cc86d20a3f93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:27:45.143666 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.auth.core [None req-8a4ddccc-8aa2-4e60-8ee3-cc86d20a3f93 None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:27:45.144870 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-8a4ddccc-8aa2-4e60-8ee3-cc86d20a3f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:27:45.153483 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 542/1059] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 21:27:45 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:27:45.194474 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25dab47-0f05-4462-a2a9-037c0ecadab6 None None] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:27:45.213971 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25dab47-0f05-4462-a2a9-037c0ecadab6 None None] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:27:45.218487 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0b4af5-f056-4722-9db2-fdb03513a21a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '704ea1ca162d4df3ab560d910d599851', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e36d923af474a07adb12209580f12e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:27:45.219109 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b4af5-f056-4722-9db2-fdb03513a21a service neutron] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:27:45.219390 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b4af5-f056-4722-9db2-fdb03513a21a service neutron] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:27:45.219661 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b4af5-f056-4722-9db2-fdb03513a21a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:27:45.229573 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0b4af5-f056-4722-9db2-fdb03513a21a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:27:45.231042 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0b4af5-f056-4722-9db2-fdb03513a21a service neutron] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:27:45.240696 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 518/1060] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 25 21:27:45 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:27:47.686051 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8503f602-2c63-4af1-ae7a-9dcfad455a67 None None] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:27:47.687014 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8503f602-2c63-4af1-ae7a-9dcfad455a67 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:27:47.687014 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8503f602-2c63-4af1-ae7a-9dcfad455a67 None None] PATH_INFO: `/` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:27:47.689135 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 543/1061] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 21:27:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:27:47.694594 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8764dfb6-be24-418c-ac6d-bfa1452e2e7c None None] REQUEST_METHOD: `POST` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:27:47.695025 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8764dfb6-be24-418c-ac6d-bfa1452e2e7c None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:27:47.695148 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8764dfb6-be24-418c-ac6d-bfa1452e2e7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:27:47.716503 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.auth.core [None req-8764dfb6-be24-418c-ac6d-bfa1452e2e7c None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:27:47.717736 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.fernet_utils [None req-8764dfb6-be24-418c-ac6d-bfa1452e2e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:27:47.726531 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 519/1062] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 21:27:47 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:27:47.768044 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8503f602-2c63-4af1-ae7a-9dcfad455a67 None None] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:27:47.787522 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8503f602-2c63-4af1-ae7a-9dcfad455a67 None None] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:27:47.793124 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae4bee0-485c-49b9-8b58-244ad788b1e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '704ea1ca162d4df3ab560d910d599851', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e36d923af474a07adb12209580f12e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:27:47.793750 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae4bee0-485c-49b9-8b58-244ad788b1e0 service neutron] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:27:47.794050 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae4bee0-485c-49b9-8b58-244ad788b1e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:27:47.794265 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae4bee0-485c-49b9-8b58-244ad788b1e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:27:47.804772 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae4bee0-485c-49b9-8b58-244ad788b1e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:27:47.806273 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae4bee0-485c-49b9-8b58-244ad788b1e0 service neutron] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:27:47.816655 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 544/1063] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 25 21:27:47 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:27:50.481831 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1b7d83-8f71-4b30-8510-69bbb86dadfe None None] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:27:50.482706 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1b7d83-8f71-4b30-8510-69bbb86dadfe None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:27:50.482706 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1b7d83-8f71-4b30-8510-69bbb86dadfe None None] PATH_INFO: `/` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:27:50.484830 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 520/1064] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 21:27:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:27:50.491258 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5096ded-159c-4833-98a5-fd4ca178b144 None None] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:27:50.491710 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5096ded-159c-4833-98a5-fd4ca178b144 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:27:50.491807 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5096ded-159c-4833-98a5-fd4ca178b144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:27:50.513552 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.auth.core [None req-b5096ded-159c-4833-98a5-fd4ca178b144 None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:27:50.514776 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-b5096ded-159c-4833-98a5-fd4ca178b144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:27:50.523618 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 545/1065] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 21:27:50 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:27:50.569294 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1b7d83-8f71-4b30-8510-69bbb86dadfe None None] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:27:50.588631 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1b7d83-8f71-4b30-8510-69bbb86dadfe None None] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:27:50.597512 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420a2aed-0cea-41e3-bea2-71b2ea50a28d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '704ea1ca162d4df3ab560d910d599851', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e36d923af474a07adb12209580f12e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:27:50.598176 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420a2aed-0cea-41e3-bea2-71b2ea50a28d service neutron] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:27:50.598442 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420a2aed-0cea-41e3-bea2-71b2ea50a28d service neutron] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:27:50.598711 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420a2aed-0cea-41e3-bea2-71b2ea50a28d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:27:50.609892 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420a2aed-0cea-41e3-bea2-71b2ea50a28d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:27:50.611341 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420a2aed-0cea-41e3-bea2-71b2ea50a28d service neutron] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:27:50.622439 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 521/1066] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 25 21:27:50 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:27:52.975205 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cc13bb-fa62-436e-b5aa-e180c6eff30a None None] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:27:52.975792 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cc13bb-fa62-436e-b5aa-e180c6eff30a None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:27:52.975792 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cc13bb-fa62-436e-b5aa-e180c6eff30a None None] PATH_INFO: `/` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:27:52.977150 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 546/1067] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 21:27:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:27:52.985796 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c111227-512a-4f39-a504-28cec438c116 None None] REQUEST_METHOD: `POST` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:27:52.986225 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c111227-512a-4f39-a504-28cec438c116 None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:27:52.986361 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c111227-512a-4f39-a504-28cec438c116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:27:53.015971 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.auth.core [None req-4c111227-512a-4f39-a504-28cec438c116 None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:27:53.017219 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.fernet_utils [None req-4c111227-512a-4f39-a504-28cec438c116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:27:53.026567 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 522/1068] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 21:27:52 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 21:27:53.079166 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cc13bb-fa62-436e-b5aa-e180c6eff30a None None] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:27:53.098136 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cc13bb-fa62-436e-b5aa-e180c6eff30a None None] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:27:53.104704 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12052681-9bd4-451a-a568-27392896877b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '704ea1ca162d4df3ab560d910d599851', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e36d923af474a07adb12209580f12e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:27:53.105359 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12052681-9bd4-451a-a568-27392896877b service neutron] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:27:53.105643 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12052681-9bd4-451a-a568-27392896877b service neutron] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:27:53.105893 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12052681-9bd4-451a-a568-27392896877b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:27:53.116086 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12052681-9bd4-451a-a568-27392896877b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:27:53.117576 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12052681-9bd4-451a-a568-27392896877b service neutron] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:27:53.127676 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 547/1069] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 25 21:27:53 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:27:55.428565 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d690d9-16cd-480f-bfa7-e41da53f082e None None] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:27:55.429599 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d690d9-16cd-480f-bfa7-e41da53f082e None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:27:55.429599 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d690d9-16cd-480f-bfa7-e41da53f082e None None] PATH_INFO: `/` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:27:55.431859 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 523/1070] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 21:27:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:27:55.440232 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12898c16-5ba6-46c6-b422-c855f933e3bd None None] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:27:55.440675 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12898c16-5ba6-46c6-b422-c855f933e3bd None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:27:55.440768 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12898c16-5ba6-46c6-b422-c855f933e3bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:27:55.461431 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.auth.core [None req-12898c16-5ba6-46c6-b422-c855f933e3bd None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:27:55.462661 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-12898c16-5ba6-46c6-b422-c855f933e3bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:27:55.472050 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 548/1071] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 21:27:55 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:27:55.512261 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d690d9-16cd-480f-bfa7-e41da53f082e None None] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:27:55.525183 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d690d9-16cd-480f-bfa7-e41da53f082e None None] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:27:55.529410 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c83d068-1e33-4c34-9b20-fdc3c4186cb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '704ea1ca162d4df3ab560d910d599851', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e36d923af474a07adb12209580f12e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:27:55.530035 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c83d068-1e33-4c34-9b20-fdc3c4186cb1 service neutron] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:27:55.530310 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c83d068-1e33-4c34-9b20-fdc3c4186cb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:27:55.530574 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c83d068-1e33-4c34-9b20-fdc3c4186cb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:27:55.541237 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c83d068-1e33-4c34-9b20-fdc3c4186cb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:27:55.542682 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c83d068-1e33-4c34-9b20-fdc3c4186cb1 service neutron] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:27:55.552773 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 524/1072] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 25 21:27:55 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:27:57.916896 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efd5aad-8d11-445d-8bd3-4b876b582296 None None] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:27:57.917500 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efd5aad-8d11-445d-8bd3-4b876b582296 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:27:57.917500 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efd5aad-8d11-445d-8bd3-4b876b582296 None None] PATH_INFO: `/` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:27:57.918758 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 549/1073] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 21:27:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:27:57.924997 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfbf3ee-090d-4682-9360-57b893e1d3ea None None] REQUEST_METHOD: `POST` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:27:57.925484 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfbf3ee-090d-4682-9360-57b893e1d3ea None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:27:57.925588 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfbf3ee-090d-4682-9360-57b893e1d3ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:27:57.935620 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=70 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:27:57.950270 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.auth.core [None req-fdfbf3ee-090d-4682-9360-57b893e1d3ea None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:27:57.952158 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.fernet_utils [None req-fdfbf3ee-090d-4682-9360-57b893e1d3ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:27:57.962283 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 525/1074] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 21:27:57 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:27:58.005003 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efd5aad-8d11-445d-8bd3-4b876b582296 None None] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:27:58.011493 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=64 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:27:58.020079 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efd5aad-8d11-445d-8bd3-4b876b582296 None None] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:27:58.025866 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f796f8ea-f891-43eb-8f10-c5f97b6b01a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '704ea1ca162d4df3ab560d910d599851', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e36d923af474a07adb12209580f12e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:27:58.026669 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f796f8ea-f891-43eb-8f10-c5f97b6b01a4 service neutron] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:27:58.026948 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f796f8ea-f891-43eb-8f10-c5f97b6b01a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:27:58.027218 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f796f8ea-f891-43eb-8f10-c5f97b6b01a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:27:58.036837 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f796f8ea-f891-43eb-8f10-c5f97b6b01a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:27:58.038331 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f796f8ea-f891-43eb-8f10-c5f97b6b01a4 service neutron] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:27:58.048411 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 550/1075] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 25 21:27:58 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:28:00.324913 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14ec3fa-732d-4b9a-b1d6-f89b4087f088 None None] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:28:00.325598 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14ec3fa-732d-4b9a-b1d6-f89b4087f088 None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:28:00.325598 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14ec3fa-732d-4b9a-b1d6-f89b4087f088 None None] PATH_INFO: `/` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:28:00.326974 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 526/1076] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 21:28:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:28:00.332553 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6de5d08-6a12-4f65-956c-a56480cf7a87 None None] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:28:00.332991 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6de5d08-6a12-4f65-956c-a56480cf7a87 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:28:00.333123 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6de5d08-6a12-4f65-956c-a56480cf7a87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:28:00.354426 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.auth.core [None req-c6de5d08-6a12-4f65-956c-a56480cf7a87 None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:28:00.355659 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-c6de5d08-6a12-4f65-956c-a56480cf7a87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:28:00.363948 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 551/1077] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 21:28:00 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:28:00.404643 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14ec3fa-732d-4b9a-b1d6-f89b4087f088 None None] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:28:00.419168 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14ec3fa-732d-4b9a-b1d6-f89b4087f088 None None] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:28:00.423407 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78ce9b2-e17a-4b7c-88da-6b6e0b5c75bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '704ea1ca162d4df3ab560d910d599851', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e36d923af474a07adb12209580f12e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:28:00.424016 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78ce9b2-e17a-4b7c-88da-6b6e0b5c75bf service neutron] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:28:00.424289 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78ce9b2-e17a-4b7c-88da-6b6e0b5c75bf service neutron] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:28:00.424543 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78ce9b2-e17a-4b7c-88da-6b6e0b5c75bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:28:00.436012 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78ce9b2-e17a-4b7c-88da-6b6e0b5c75bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:28:00.437526 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78ce9b2-e17a-4b7c-88da-6b6e0b5c75bf service neutron] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:28:00.447188 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 527/1078] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 25 21:28:00 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:28:02.768648 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0f7ac6-6e5d-49a8-a062-f7bc885d054f None None] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:28:02.769700 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0f7ac6-6e5d-49a8-a062-f7bc885d054f None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:28:02.769700 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0f7ac6-6e5d-49a8-a062-f7bc885d054f None None] PATH_INFO: `/` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:28:02.771742 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 552/1079] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 21:28:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:28:02.780970 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bafd05-4c38-4bf2-b6f0-5ddf57086ef6 None None] REQUEST_METHOD: `POST` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:28:02.781447 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bafd05-4c38-4bf2-b6f0-5ddf57086ef6 None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:28:02.781704 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bafd05-4c38-4bf2-b6f0-5ddf57086ef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:28:02.805864 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.auth.core [None req-f7bafd05-4c38-4bf2-b6f0-5ddf57086ef6 None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:28:02.807135 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.fernet_utils [None req-f7bafd05-4c38-4bf2-b6f0-5ddf57086ef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:28:02.815391 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 528/1080] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 21:28:02 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:28:02.854834 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0f7ac6-6e5d-49a8-a062-f7bc885d054f None None] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:28:02.872204 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0f7ac6-6e5d-49a8-a062-f7bc885d054f None None] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:28:02.877147 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417198e8-1481-4da8-987a-6b5e0bb4ade9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '704ea1ca162d4df3ab560d910d599851', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e36d923af474a07adb12209580f12e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:28:02.877770 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417198e8-1481-4da8-987a-6b5e0bb4ade9 service neutron] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:28:02.878047 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417198e8-1481-4da8-987a-6b5e0bb4ade9 service neutron] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:28:02.878316 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417198e8-1481-4da8-987a-6b5e0bb4ade9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:28:02.888793 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417198e8-1481-4da8-987a-6b5e0bb4ade9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:28:02.890310 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417198e8-1481-4da8-987a-6b5e0bb4ade9 service neutron] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:28:02.900031 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 553/1081] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 25 21:28:02 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:28:05.201123 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d9c0fc-486f-44de-97a2-5331202cc376 None None] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:28:05.201752 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d9c0fc-486f-44de-97a2-5331202cc376 None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:28:05.201752 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d9c0fc-486f-44de-97a2-5331202cc376 None None] PATH_INFO: `/` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:28:05.202957 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 529/1082] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 21:28:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:28:05.209531 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de512691-b23d-410b-a179-a7d8b5f7ae92 None None] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:28:05.210263 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de512691-b23d-410b-a179-a7d8b5f7ae92 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:28:05.210437 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de512691-b23d-410b-a179-a7d8b5f7ae92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:28:05.232578 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.auth.core [None req-de512691-b23d-410b-a179-a7d8b5f7ae92 None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:28:05.233947 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-de512691-b23d-410b-a179-a7d8b5f7ae92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:28:05.242859 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 554/1083] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 21:28:05 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:28:05.284923 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d9c0fc-486f-44de-97a2-5331202cc376 None None] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:28:05.300181 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d9c0fc-486f-44de-97a2-5331202cc376 None None] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:28:05.304445 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c3647d-e662-4809-8622-0a97f53ee101 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '704ea1ca162d4df3ab560d910d599851', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e36d923af474a07adb12209580f12e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:28:05.305052 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c3647d-e662-4809-8622-0a97f53ee101 service neutron] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:28:05.305363 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c3647d-e662-4809-8622-0a97f53ee101 service neutron] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:28:05.305624 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c3647d-e662-4809-8622-0a97f53ee101 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:28:05.314742 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c3647d-e662-4809-8622-0a97f53ee101 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:28:05.316174 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c3647d-e662-4809-8622-0a97f53ee101 service neutron] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:28:05.325501 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 530/1084] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 25 21:28:05 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:28:07.579181 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c1876-c512-4129-a825-19d0f014878e None None] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:28:07.579809 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c1876-c512-4129-a825-19d0f014878e None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:28:07.579809 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c1876-c512-4129-a825-19d0f014878e None None] PATH_INFO: `/` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:28:07.581111 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 555/1085] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 21:28:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:28:07.587329 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32f8d48-cc81-48c8-b57e-ef796b00450c None None] REQUEST_METHOD: `POST` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:28:07.587829 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32f8d48-cc81-48c8-b57e-ef796b00450c None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:28:07.587829 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32f8d48-cc81-48c8-b57e-ef796b00450c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:28:07.613799 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.auth.core [None req-c32f8d48-cc81-48c8-b57e-ef796b00450c None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:28:07.614988 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.fernet_utils [None req-c32f8d48-cc81-48c8-b57e-ef796b00450c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:28:07.624791 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 531/1086] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 21:28:07 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:28:07.665756 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310c1876-c512-4129-a825-19d0f014878e None None] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:28:07.678339 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310c1876-c512-4129-a825-19d0f014878e None None] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:28:07.682636 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0e53c0-dc80-4d8e-8b7a-e92c981f5349 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '704ea1ca162d4df3ab560d910d599851', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e36d923af474a07adb12209580f12e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:28:07.683252 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0e53c0-dc80-4d8e-8b7a-e92c981f5349 service neutron] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:28:07.683532 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0e53c0-dc80-4d8e-8b7a-e92c981f5349 service neutron] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:28:07.683807 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0e53c0-dc80-4d8e-8b7a-e92c981f5349 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:28:07.695404 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0e53c0-dc80-4d8e-8b7a-e92c981f5349 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:28:07.696853 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0e53c0-dc80-4d8e-8b7a-e92c981f5349 service neutron] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:28:07.706524 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 556/1087] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 25 21:28:07 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:28:17.608688 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=20 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:28:17.702329 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=23 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:28:31.342346 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea47417f-a6a4-4838-8b63-d5f283d20374 None None] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:28:31.343253 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea47417f-a6a4-4838-8b63-d5f283d20374 None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:28:31.343253 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea47417f-a6a4-4838-8b63-d5f283d20374 None None] PATH_INFO: `/` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:28:31.345482 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 532/1088] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:28:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:28:31.353547 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde603da-e51e-4e20-9373-5544da3c1b53 None None] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:28:31.354068 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde603da-e51e-4e20-9373-5544da3c1b53 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:28:31.354068 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde603da-e51e-4e20-9373-5544da3c1b53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:28:31.374638 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.auth.core [None req-dde603da-e51e-4e20-9373-5544da3c1b53 None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:28:31.375827 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-dde603da-e51e-4e20-9373-5544da3c1b53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:28:31.384663 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 557/1089] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:28:31 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 21:28:31.434832 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c78785-35b6-4b1f-8653-d917deac2f67 None None] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:28:31.435107 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c78785-35b6-4b1f-8653-d917deac2f67 None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:28:31.435376 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c78785-35b6-4b1f-8653-d917deac2f67 None None] PATH_INFO: `/` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:28:31.436724 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 533/1090] 10.222.0.66 () {54 vars in 966 bytes} [Mon Jul 25 21:28:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:28:31.442920 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6c5eaa-aae9-4d05-9ee7-25f0ef2e9fbd None None] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:28:31.443204 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6c5eaa-aae9-4d05-9ee7-25f0ef2e9fbd None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:28:31.443481 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6c5eaa-aae9-4d05-9ee7-25f0ef2e9fbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:28:31.470106 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.auth.core [None req-fb6c5eaa-aae9-4d05-9ee7-25f0ef2e9fbd None None] MFA Rules not processed for user `1b47561e7cd048f79518db147de16c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=87209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:28:31.471239 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-fb6c5eaa-aae9-4d05-9ee7-25f0ef2e9fbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:28:31.478578 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 558/1091] 10.222.0.66 () {58 vars in 1063 bytes} [Mon Jul 25 21:28:31 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:28:31.490102 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c78785-35b6-4b1f-8653-d917deac2f67 None None] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:28:31.503272 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c78785-35b6-4b1f-8653-d917deac2f67 None None] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:28:31.508091 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4f8719-b963-48b6-a793-91153c90a2cb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b47561e7cd048f79518db147de16c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e36d923af474a07adb12209580f12e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:28:31.508717 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4f8719-b963-48b6-a793-91153c90a2cb service glance] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:28:31.508996 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4f8719-b963-48b6-a793-91153c90a2cb service glance] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:28:31.509306 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4f8719-b963-48b6-a793-91153c90a2cb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:28:31.520436 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4f8719-b963-48b6-a793-91153c90a2cb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:28:31.522606 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4f8719-b963-48b6-a793-91153c90a2cb service glance] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:28:31.534014 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 534/1092] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 25 21:28:31 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 21:28:33.871883 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb77690-ab8a-442f-b9e5-d6a8d7c08ddd None None] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:28:33.872896 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb77690-ab8a-442f-b9e5-d6a8d7c08ddd None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:28:33.872896 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb77690-ab8a-442f-b9e5-d6a8d7c08ddd None None] PATH_INFO: `/` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:28:33.875005 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 559/1093] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:28:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:28:33.880571 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eecda78-a360-411e-9ed8-f455764961b8 None None] REQUEST_METHOD: `POST` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:28:33.881037 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eecda78-a360-411e-9ed8-f455764961b8 None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:28:33.881163 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eecda78-a360-411e-9ed8-f455764961b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:28:33.903010 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.auth.core [None req-9eecda78-a360-411e-9ed8-f455764961b8 None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:28:33.904191 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.fernet_utils [None req-9eecda78-a360-411e-9ed8-f455764961b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:28:33.913361 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 535/1094] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:28:33 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:28:33.937695 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb77690-ab8a-442f-b9e5-d6a8d7c08ddd None None] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:28:33.951684 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb77690-ab8a-442f-b9e5-d6a8d7c08ddd None None] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:28:33.956825 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04587dbb-52c0-4002-b0c0-e45da3549f52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9501d798e8481da3be76351eec2bf6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:28:33.957462 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04587dbb-52c0-4002-b0c0-e45da3549f52 admin admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:28:33.957709 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04587dbb-52c0-4002-b0c0-e45da3549f52 admin admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:28:33.958011 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04587dbb-52c0-4002-b0c0-e45da3549f52 admin admin] PATH_INFO: `/v3/projects` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:28:33.958705 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04587dbb-52c0-4002-b0c0-e45da3549f52 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:28:33.960483 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: WARNING py.warnings [None req-04587dbb-52c0-4002-b0c0-e45da3549f52 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 21:28:33.960483 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: warnings.warn(msg) Jul 25 21:28:33.960483 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: Jul 25 21:28:33.961668 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04587dbb-52c0-4002-b0c0-e45da3549f52 admin admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:28:33.980557 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 560/1095] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 25 21:28:33 2022] GET /identity/v3/projects => generated 1606 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 21:28:36.452485 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dc504b-621b-42db-9f94-40c1b8dcf8c5 None None] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:28:36.453336 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dc504b-621b-42db-9f94-40c1b8dcf8c5 None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:28:36.453336 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dc504b-621b-42db-9f94-40c1b8dcf8c5 None None] PATH_INFO: `/` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:28:36.455146 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 536/1096] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:28:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:28:36.461804 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8687ff46-f016-4e9b-8149-6e0012638c92 None None] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:28:36.462261 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8687ff46-f016-4e9b-8149-6e0012638c92 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:28:36.462376 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8687ff46-f016-4e9b-8149-6e0012638c92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:28:36.485845 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.auth.core [None req-8687ff46-f016-4e9b-8149-6e0012638c92 None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:28:36.487075 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-8687ff46-f016-4e9b-8149-6e0012638c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:28:36.496674 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 561/1097] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:28:36 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:28:36.545748 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dc504b-621b-42db-9f94-40c1b8dcf8c5 None None] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:28:36.564081 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dc504b-621b-42db-9f94-40c1b8dcf8c5 None None] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:28:36.569647 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0e781f-cd02-4fc2-93c9-5d90dd3fa9d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '524584f0d1b64e02a467b47de395c130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e36d923af474a07adb12209580f12e1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:28:36.570256 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0e781f-cd02-4fc2-93c9-5d90dd3fa9d9 service nova] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:28:36.570527 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0e781f-cd02-4fc2-93c9-5d90dd3fa9d9 service nova] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:28:36.570795 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0e781f-cd02-4fc2-93c9-5d90dd3fa9d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:28:36.580362 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0e781f-cd02-4fc2-93c9-5d90dd3fa9d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:28:36.582135 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0e781f-cd02-4fc2-93c9-5d90dd3fa9d9 service nova] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:28:36.592528 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 537/1098] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 25 21:28:36 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:28:39.049519 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c356579e-1b53-490f-a8bc-9ef845e48e1d None None] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:28:39.050095 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c356579e-1b53-490f-a8bc-9ef845e48e1d None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:28:39.050095 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c356579e-1b53-490f-a8bc-9ef845e48e1d None None] PATH_INFO: `/` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:28:39.052179 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 562/1099] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:28:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:28:39.059550 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142a1cfb-5aaa-41c8-83cc-89a7ae6885c0 None None] REQUEST_METHOD: `POST` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:28:39.060034 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142a1cfb-5aaa-41c8-83cc-89a7ae6885c0 None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:28:39.060034 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142a1cfb-5aaa-41c8-83cc-89a7ae6885c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:28:39.080784 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.auth.core [None req-142a1cfb-5aaa-41c8-83cc-89a7ae6885c0 None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:28:39.082019 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.fernet_utils [None req-142a1cfb-5aaa-41c8-83cc-89a7ae6885c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:28:39.091233 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 538/1100] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:28:39 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 21:28:39.128630 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c356579e-1b53-490f-a8bc-9ef845e48e1d None None] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:28:39.140507 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c356579e-1b53-490f-a8bc-9ef845e48e1d None None] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:28:39.144685 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fb2567-1426-4e41-ae67-6fa8b0b316d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '704ea1ca162d4df3ab560d910d599851', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e36d923af474a07adb12209580f12e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:28:39.145322 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fb2567-1426-4e41-ae67-6fa8b0b316d4 service neutron] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:28:39.145597 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fb2567-1426-4e41-ae67-6fa8b0b316d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:28:39.145863 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fb2567-1426-4e41-ae67-6fa8b0b316d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:28:39.154901 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fb2567-1426-4e41-ae67-6fa8b0b316d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:28:39.156340 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fb2567-1426-4e41-ae67-6fa8b0b316d4 service neutron] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:28:39.166009 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 563/1101] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 25 21:28:39 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:28:41.442221 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e686b6-a5e2-44f4-bc6c-1a874d76e0ad None None] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:28:41.443079 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e686b6-a5e2-44f4-bc6c-1a874d76e0ad None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:28:41.443079 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e686b6-a5e2-44f4-bc6c-1a874d76e0ad None None] PATH_INFO: `/` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:28:41.445397 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 539/1102] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:28:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:28:41.452071 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5979a5f-2856-444e-8cf7-a0fe7baabdf6 None None] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:28:41.452534 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5979a5f-2856-444e-8cf7-a0fe7baabdf6 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:28:41.452534 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5979a5f-2856-444e-8cf7-a0fe7baabdf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:28:41.474246 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.auth.core [None req-d5979a5f-2856-444e-8cf7-a0fe7baabdf6 None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:28:41.475493 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-d5979a5f-2856-444e-8cf7-a0fe7baabdf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:28:41.484373 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 564/1103] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:28:41 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 21:28:41.526787 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e686b6-a5e2-44f4-bc6c-1a874d76e0ad None None] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:28:41.544503 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e686b6-a5e2-44f4-bc6c-1a874d76e0ad None None] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:28:41.548906 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1842680-e0f7-45cd-bf88-aa2f05232535 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '704ea1ca162d4df3ab560d910d599851', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e36d923af474a07adb12209580f12e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:28:41.549564 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1842680-e0f7-45cd-bf88-aa2f05232535 service neutron] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:28:41.549836 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1842680-e0f7-45cd-bf88-aa2f05232535 service neutron] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:28:41.550086 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1842680-e0f7-45cd-bf88-aa2f05232535 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:28:41.559676 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1842680-e0f7-45cd-bf88-aa2f05232535 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:28:41.561105 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1842680-e0f7-45cd-bf88-aa2f05232535 service neutron] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:28:41.571250 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 540/1104] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 25 21:28:41 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:28:43.994655 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598f396f-3916-4bbe-ad72-d7af7437cb07 None None] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:28:43.995196 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598f396f-3916-4bbe-ad72-d7af7437cb07 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:28:43.995196 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598f396f-3916-4bbe-ad72-d7af7437cb07 None None] PATH_INFO: `/` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:28:43.996624 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 565/1105] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:28:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:28:44.003108 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c213d7d-e5e6-4f70-a112-d8d165a2c578 None None] REQUEST_METHOD: `POST` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:28:44.003891 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c213d7d-e5e6-4f70-a112-d8d165a2c578 None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:28:44.004043 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c213d7d-e5e6-4f70-a112-d8d165a2c578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:28:44.028707 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.auth.core [None req-6c213d7d-e5e6-4f70-a112-d8d165a2c578 None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:28:44.029966 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.fernet_utils [None req-6c213d7d-e5e6-4f70-a112-d8d165a2c578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:28:44.039147 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 541/1106] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:28:44 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:28:44.083952 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598f396f-3916-4bbe-ad72-d7af7437cb07 None None] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:28:44.096984 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598f396f-3916-4bbe-ad72-d7af7437cb07 None None] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:28:44.101053 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a7bef4-7ebb-480d-bb02-8d07ca3ebd15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '704ea1ca162d4df3ab560d910d599851', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e36d923af474a07adb12209580f12e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:28:44.101716 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a7bef4-7ebb-480d-bb02-8d07ca3ebd15 service neutron] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:28:44.101993 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a7bef4-7ebb-480d-bb02-8d07ca3ebd15 service neutron] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:28:44.102261 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a7bef4-7ebb-480d-bb02-8d07ca3ebd15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:28:44.114726 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a7bef4-7ebb-480d-bb02-8d07ca3ebd15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:28:44.116813 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a7bef4-7ebb-480d-bb02-8d07ca3ebd15 service neutron] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:28:44.128128 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 566/1107] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 25 21:28:44 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:28:46.677866 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c68f4bf-213e-413e-aef9-ba21bd2adeb6 None None] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:28:46.678731 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c68f4bf-213e-413e-aef9-ba21bd2adeb6 None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:28:46.678731 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c68f4bf-213e-413e-aef9-ba21bd2adeb6 None None] PATH_INFO: `/` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:28:46.680905 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 542/1108] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 25 21:28:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:28:46.687986 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dfc527-b2a4-4798-a0d3-4318597ecf5b None None] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:28:46.688711 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dfc527-b2a4-4798-a0d3-4318597ecf5b None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:28:46.689123 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dfc527-b2a4-4798-a0d3-4318597ecf5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:28:46.718425 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.auth.core [None req-b3dfc527-b2a4-4798-a0d3-4318597ecf5b None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:28:46.719622 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-b3dfc527-b2a4-4798-a0d3-4318597ecf5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:28:46.728613 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 567/1109] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 25 21:28:46 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:28:46.777330 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c68f4bf-213e-413e-aef9-ba21bd2adeb6 None None] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:28:46.792906 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c68f4bf-213e-413e-aef9-ba21bd2adeb6 None None] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:28:46.798124 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fae8eb4-9c05-4def-bca8-2130ce05cd59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '704ea1ca162d4df3ab560d910d599851', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e36d923af474a07adb12209580f12e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:28:46.798744 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fae8eb4-9c05-4def-bca8-2130ce05cd59 service neutron] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:28:46.799022 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fae8eb4-9c05-4def-bca8-2130ce05cd59 service neutron] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:28:46.799279 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fae8eb4-9c05-4def-bca8-2130ce05cd59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:28:46.809976 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fae8eb4-9c05-4def-bca8-2130ce05cd59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:28:46.811433 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fae8eb4-9c05-4def-bca8-2130ce05cd59 service neutron] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:28:46.820947 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 543/1110] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 25 21:28:46 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:28:56.713121 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=33 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:28:56.817155 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=33 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:30:32.410992 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5254d6eb-9488-4e11-8a24-4d20c587c86a None None] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:30:32.411647 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5254d6eb-9488-4e11-8a24-4d20c587c86a None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:30:32.411647 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5254d6eb-9488-4e11-8a24-4d20c587c86a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:30:32.433605 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.auth.core [None req-5254d6eb-9488-4e11-8a24-4d20c587c86a None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:30:32.434879 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-5254d6eb-9488-4e11-8a24-4d20c587c86a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:30:32.444502 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 568/1111] 10.222.0.66 () {58 vars in 958 bytes} [Mon Jul 25 21:30:32 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:30:32.456991 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3862c8d-3ccf-4e0f-aec6-61220d5532a6 None None] REQUEST_METHOD: `POST` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:30:32.457555 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3862c8d-3ccf-4e0f-aec6-61220d5532a6 None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:30:32.457555 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3862c8d-3ccf-4e0f-aec6-61220d5532a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:30:32.482785 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.auth.core [None req-b3862c8d-3ccf-4e0f-aec6-61220d5532a6 None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:30:32.484001 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.fernet_utils [None req-b3862c8d-3ccf-4e0f-aec6-61220d5532a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:30:32.495895 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 544/1112] 10.222.0.66 () {58 vars in 958 bytes} [Mon Jul 25 21:30:32 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:30:32.500840 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5254d6eb-9488-4e11-8a24-4d20c587c86a None None] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:30:32.511763 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5254d6eb-9488-4e11-8a24-4d20c587c86a None None] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:30:32.517786 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09502ba2-3fd9-4f4f-af5e-02fd0dbd0cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9501d798e8481da3be76351eec2bf6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:30:32.518405 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09502ba2-3fd9-4f4f-af5e-02fd0dbd0cd1 admin admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:30:32.518684 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09502ba2-3fd9-4f4f-af5e-02fd0dbd0cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:30:32.518956 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09502ba2-3fd9-4f4f-af5e-02fd0dbd0cd1 admin admin] PATH_INFO: `/v3/domains` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:30:32.519647 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09502ba2-3fd9-4f4f-af5e-02fd0dbd0cd1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:30:32.519953 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09502ba2-3fd9-4f4f-af5e-02fd0dbd0cd1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:30:32.520978 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: WARNING py.warnings [None req-09502ba2-3fd9-4f4f-af5e-02fd0dbd0cd1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 21:30:32.520978 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: warnings.warn(msg) Jul 25 21:30:32.520978 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: Jul 25 21:30:32.521913 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09502ba2-3fd9-4f4f-af5e-02fd0dbd0cd1 admin admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:30:32.534590 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 569/1113] 10.222.0.66 () {58 vars in 1153 bytes} [Mon Jul 25 21:30:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:30:32.545991 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3862c8d-3ccf-4e0f-aec6-61220d5532a6 None None] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:30:32.556614 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3862c8d-3ccf-4e0f-aec6-61220d5532a6 None None] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:30:32.562490 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bee5706-e1e5-40ca-bcd7-13bd4aa1f4a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9501d798e8481da3be76351eec2bf6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:30:32.563116 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee5706-e1e5-40ca-bcd7-13bd4aa1f4a5 admin admin] REQUEST_METHOD: `POST` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:30:32.563390 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee5706-e1e5-40ca-bcd7-13bd4aa1f4a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:30:32.563656 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee5706-e1e5-40ca-bcd7-13bd4aa1f4a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:30:32.564317 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bee5706-e1e5-40ca-bcd7-13bd4aa1f4a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:30:32.566151 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: WARNING py.warnings [None req-3bee5706-e1e5-40ca-bcd7-13bd4aa1f4a5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 21:30:32.566151 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: warnings.warn(msg) Jul 25 21:30:32.566151 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: Jul 25 21:30:32.567374 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bee5706-e1e5-40ca-bcd7-13bd4aa1f4a5 admin admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:30:32.599766 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 545/1114] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Jul 25 21:30:32 2022] POST /identity/v3/projects => generated 377 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 21:30:32.604359 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09502ba2-3fd9-4f4f-af5e-02fd0dbd0cd1 admin admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:30:32.614704 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09502ba2-3fd9-4f4f-af5e-02fd0dbd0cd1 admin admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:30:32.672847 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cdd5aa-388d-4675-8cee-5adffa14b7cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9501d798e8481da3be76351eec2bf6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:30:32.673590 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cdd5aa-388d-4675-8cee-5adffa14b7cf admin admin] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:30:32.673864 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cdd5aa-388d-4675-8cee-5adffa14b7cf admin admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:30:32.674137 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cdd5aa-388d-4675-8cee-5adffa14b7cf admin admin] PATH_INFO: `/v3/users` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:30:32.674797 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cdd5aa-388d-4675-8cee-5adffa14b7cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:30:32.675841 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: WARNING py.warnings [None req-14cdd5aa-388d-4675-8cee-5adffa14b7cf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 21:30:32.675841 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: warnings.warn(msg) Jul 25 21:30:32.675841 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: Jul 25 21:30:32.677072 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cdd5aa-388d-4675-8cee-5adffa14b7cf admin admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:30:32.699484 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 570/1115] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Jul 25 21:30:32 2022] POST /identity/v3/users => generated 289 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 21:30:32.703849 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bee5706-e1e5-40ca-bcd7-13bd4aa1f4a5 admin admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:30:32.714928 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bee5706-e1e5-40ca-bcd7-13bd4aa1f4a5 admin admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:30:32.720937 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029024a5-eb99-4eaa-b667-6d784b6cb832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9501d798e8481da3be76351eec2bf6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:30:32.721599 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029024a5-eb99-4eaa-b667-6d784b6cb832 admin admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:30:32.721851 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029024a5-eb99-4eaa-b667-6d784b6cb832 admin admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:30:32.722148 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029024a5-eb99-4eaa-b667-6d784b6cb832 admin admin] PATH_INFO: `/v3/roles` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:30:32.722867 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029024a5-eb99-4eaa-b667-6d784b6cb832 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:30:32.723846 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: WARNING py.warnings [None req-029024a5-eb99-4eaa-b667-6d784b6cb832 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 21:30:32.723846 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: warnings.warn(msg) Jul 25 21:30:32.723846 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: Jul 25 21:30:32.724724 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029024a5-eb99-4eaa-b667-6d784b6cb832 admin admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:30:32.738099 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 546/1116] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Jul 25 21:30:32 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 21:30:32.742329 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cdd5aa-388d-4675-8cee-5adffa14b7cf admin admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:30:32.753246 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cdd5aa-388d-4675-8cee-5adffa14b7cf admin admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:30:32.759112 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d7caf5-b2d8-49f0-a24d-30a996b29f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9501d798e8481da3be76351eec2bf6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:30:32.759737 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d7caf5-b2d8-49f0-a24d-30a996b29f50 admin admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:30:32.760019 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d7caf5-b2d8-49f0-a24d-30a996b29f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:30:32.760275 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d7caf5-b2d8-49f0-a24d-30a996b29f50 admin admin] PATH_INFO: `/v3/roles` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:30:32.760970 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d7caf5-b2d8-49f0-a24d-30a996b29f50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:30:32.762027 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: WARNING py.warnings [None req-67d7caf5-b2d8-49f0-a24d-30a996b29f50 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 21:30:32.762027 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: warnings.warn(msg) Jul 25 21:30:32.762027 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: Jul 25 21:30:32.762922 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d7caf5-b2d8-49f0-a24d-30a996b29f50 admin admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:30:32.777624 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 571/1117] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Jul 25 21:30:32 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 21:30:32.782199 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029024a5-eb99-4eaa-b667-6d784b6cb832 admin admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:30:32.793286 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029024a5-eb99-4eaa-b667-6d784b6cb832 admin admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:30:32.799172 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0258c852-74d4-4378-90f2-1cf6e1fd7d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9501d798e8481da3be76351eec2bf6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:30:32.799840 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0258c852-74d4-4378-90f2-1cf6e1fd7d9d admin admin] REQUEST_METHOD: `PUT` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:30:32.800117 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0258c852-74d4-4378-90f2-1cf6e1fd7d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:30:32.800399 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0258c852-74d4-4378-90f2-1cf6e1fd7d9d admin admin] PATH_INFO: `/v3/projects/89c03b90154c4b4aaab4f002b66c0a68/users/facd1eae8db84dd78e17142479339ab2/roles/faec70ea0ba040efa587f542f054e49e` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:30:32.816899 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0258c852-74d4-4378-90f2-1cf6e1fd7d9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=89c03b90154c4b4aaab4f002b66c0a68, user_id=facd1eae8db84dd78e17142479339ab2, role_id=faec70ea0ba040efa587f542f054e49e)` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:30:32.817968 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: WARNING py.warnings [None req-0258c852-74d4-4378-90f2-1cf6e1fd7d9d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 21:30:32.817968 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: warnings.warn(msg) Jul 25 21:30:32.817968 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: Jul 25 21:30:32.819919 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0258c852-74d4-4378-90f2-1cf6e1fd7d9d admin admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:30:32.837223 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 547/1118] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Jul 25 21:30:32 2022] PUT /identity/v3/projects/89c03b90154c4b4aaab4f002b66c0a68/users/facd1eae8db84dd78e17142479339ab2/roles/faec70ea0ba040efa587f542f054e49e => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 21:30:32.851470 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cb6fd5-3906-4b0c-b451-1d1005a370a0 None None] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:30:32.851850 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cb6fd5-3906-4b0c-b451-1d1005a370a0 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:30:32.852134 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cb6fd5-3906-4b0c-b451-1d1005a370a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:30:32.887345 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.auth.core [None req-13cb6fd5-3906-4b0c-b451-1d1005a370a0 None None] MFA Rules not processed for user `facd1eae8db84dd78e17142479339ab2`. Rule list: `[]` (Enabled: `True`). {{(pid=87209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:30:32.888559 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-13cb6fd5-3906-4b0c-b451-1d1005a370a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:30:32.960785 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 572/1119] 10.222.0.66 () {58 vars in 958 bytes} [Mon Jul 25 21:30:32 2022] POST /identity/v3/auth/tokens => generated 2804 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:30:32.973507 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ce2ce2-33f0-432c-bb99-54682c686927 None None] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:30:32.973796 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ce2ce2-33f0-432c-bb99-54682c686927 None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:30:32.974075 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ce2ce2-33f0-432c-bb99-54682c686927 None None] PATH_INFO: `/` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:30:32.975462 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 548/1120] 10.222.0.66 () {54 vars in 964 bytes} [Mon Jul 25 21:30:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:30:32.980377 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6185f25f-6dcf-4d9b-99c4-764ceaa342c4 None None] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:30:32.980661 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6185f25f-6dcf-4d9b-99c4-764ceaa342c4 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:30:32.980936 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6185f25f-6dcf-4d9b-99c4-764ceaa342c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:30:33.000601 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.auth.core [None req-6185f25f-6dcf-4d9b-99c4-764ceaa342c4 None None] MFA Rules not processed for user `b36a8b42b275490d8f7fbd4e16f398fa`. Rule list: `[]` (Enabled: `True`). {{(pid=87209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:30:33.001858 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-6185f25f-6dcf-4d9b-99c4-764ceaa342c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:30:33.050180 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:30:33.061423 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 573/1121] 10.222.0.66 () {58 vars in 1061 bytes} [Mon Jul 25 21:30:32 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:30:33.069381 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ce2ce2-33f0-432c-bb99-54682c686927 None None] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:30:33.084380 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ce2ce2-33f0-432c-bb99-54682c686927 None None] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:30:33.088476 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21253583-8b51-4ba3-ad7b-9b64eaa35e3b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36a8b42b275490d8f7fbd4e16f398fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e36d923af474a07adb12209580f12e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:30:33.089110 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21253583-8b51-4ba3-ad7b-9b64eaa35e3b service cinder] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:30:33.089396 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21253583-8b51-4ba3-ad7b-9b64eaa35e3b service cinder] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:30:33.089665 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21253583-8b51-4ba3-ad7b-9b64eaa35e3b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:30:33.098479 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21253583-8b51-4ba3-ad7b-9b64eaa35e3b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:30:33.099899 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21253583-8b51-4ba3-ad7b-9b64eaa35e3b service cinder] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:30:33.108562 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 549/1122] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 25 21:30:33 2022] GET /identity/v3/auth/tokens => generated 2804 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:30:33.151962 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9850d604-b046-4633-9a38-6f59cb3f47f6 None None] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:30:33.152251 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9850d604-b046-4633-9a38-6f59cb3f47f6 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:30:33.152527 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9850d604-b046-4633-9a38-6f59cb3f47f6 None None] PATH_INFO: `/` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:30:33.153965 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 574/1123] 10.222.0.66 () {52 vars in 830 bytes} [Mon Jul 25 21:30:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:30:33.159700 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21253583-8b51-4ba3-ad7b-9b64eaa35e3b service cinder] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:30:33.224879 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21253583-8b51-4ba3-ad7b-9b64eaa35e3b service cinder] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:30:33.230280 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1933de-7dbf-44a0-b6c3-1eed9c5ca3f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9501d798e8481da3be76351eec2bf6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:30:33.230915 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1933de-7dbf-44a0-b6c3-1eed9c5ca3f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:30:33.231191 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1933de-7dbf-44a0-b6c3-1eed9c5ca3f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:30:33.231461 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1933de-7dbf-44a0-b6c3-1eed9c5ca3f9 admin admin] PATH_INFO: `/v3/users/facd1eae8db84dd78e17142479339ab2` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:30:33.232743 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1933de-7dbf-44a0-b6c3-1eed9c5ca3f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=facd1eae8db84dd78e17142479339ab2)` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:30:33.233800 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: WARNING py.warnings [None req-7e1933de-7dbf-44a0-b6c3-1eed9c5ca3f9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 21:30:33.233800 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: warnings.warn(msg) Jul 25 21:30:33.233800 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: Jul 25 21:30:33.234992 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1933de-7dbf-44a0-b6c3-1eed9c5ca3f9 admin admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:30:33.308638 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.notifications [None req-7e1933de-7dbf-44a0-b6c3-1eed9c5ca3f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'facd1eae8db84dd78e17142479339ab2'} {{(pid=87210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 21:30:33.328379 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.notifications [None req-7e1933de-7dbf-44a0-b6c3-1eed9c5ca3f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'facd1eae8db84dd78e17142479339ab2'} {{(pid=87210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 21:30:33.329435 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.notifications [None req-7e1933de-7dbf-44a0-b6c3-1eed9c5ca3f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'facd1eae8db84dd78e17142479339ab2'} {{(pid=87210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 21:30:33.342221 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.notifications [None req-7e1933de-7dbf-44a0-b6c3-1eed9c5ca3f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'facd1eae8db84dd78e17142479339ab2'} {{(pid=87210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 21:30:33.361984 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.notifications [None req-7e1933de-7dbf-44a0-b6c3-1eed9c5ca3f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'facd1eae8db84dd78e17142479339ab2'} {{(pid=87210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 21:30:33.368185 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 550/1124] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Jul 25 21:30:33 2022] DELETE /identity/v3/users/facd1eae8db84dd78e17142479339ab2 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 21:30:33.372917 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34378961-f2b6-4fc9-b875-7340255601a4 None None] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:30:33.373267 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34378961-f2b6-4fc9-b875-7340255601a4 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:30:33.373545 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34378961-f2b6-4fc9-b875-7340255601a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:30:33.394532 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.auth.core [None req-34378961-f2b6-4fc9-b875-7340255601a4 None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:30:33.396446 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-34378961-f2b6-4fc9-b875-7340255601a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:30:33.462531 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 575/1125] 10.222.0.66 () {58 vars in 958 bytes} [Mon Jul 25 21:30:33 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:30:33.472498 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1933de-7dbf-44a0-b6c3-1eed9c5ca3f9 admin admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:30:33.474160 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.fernet_utils [None req-7e1933de-7dbf-44a0-b6c3-1eed9c5ca3f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:30:33.480513 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:30:33.544278 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1933de-7dbf-44a0-b6c3-1eed9c5ca3f9 admin admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:30:33.550692 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b314cc8-1d21-4b6e-9eef-e77eec33e5e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '704ea1ca162d4df3ab560d910d599851', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e36d923af474a07adb12209580f12e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:30:33.551327 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b314cc8-1d21-4b6e-9eef-e77eec33e5e3 service neutron] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:30:33.551602 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b314cc8-1d21-4b6e-9eef-e77eec33e5e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:30:33.551869 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b314cc8-1d21-4b6e-9eef-e77eec33e5e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:30:33.563458 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b314cc8-1d21-4b6e-9eef-e77eec33e5e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:30:33.565316 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b314cc8-1d21-4b6e-9eef-e77eec33e5e3 service neutron] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:30:33.575388 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 551/1126] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 25 21:30:33 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:30:33.981316 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34378961-f2b6-4fc9-b875-7340255601a4 None None] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:30:33.982816 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-34378961-f2b6-4fc9-b875-7340255601a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:30:33.996212 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34378961-f2b6-4fc9-b875-7340255601a4 None None] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:30:34.002098 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3defaa1-2f16-4576-9fa0-723934eaa6c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9501d798e8481da3be76351eec2bf6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:30:34.002899 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3defaa1-2f16-4576-9fa0-723934eaa6c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:30:34.003176 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3defaa1-2f16-4576-9fa0-723934eaa6c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:30:34.003455 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3defaa1-2f16-4576-9fa0-723934eaa6c7 admin admin] PATH_INFO: `/v3/projects/89c03b90154c4b4aaab4f002b66c0a68` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:30:34.004770 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3defaa1-2f16-4576-9fa0-723934eaa6c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89c03b90154c4b4aaab4f002b66c0a68)` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:30:34.005856 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: WARNING py.warnings [None req-d3defaa1-2f16-4576-9fa0-723934eaa6c7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 21:30:34.005856 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: warnings.warn(msg) Jul 25 21:30:34.005856 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: Jul 25 21:30:34.007155 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3defaa1-2f16-4576-9fa0-723934eaa6c7 admin admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:30:34.073559 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.notifications [None req-d3defaa1-2f16-4576-9fa0-723934eaa6c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89c03b90154c4b4aaab4f002b66c0a68', 'request_id': 'req-d3defaa1-2f16-4576-9fa0-723934eaa6c7'} {{(pid=87209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 21:30:34.080470 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.notifications [None req-d3defaa1-2f16-4576-9fa0-723934eaa6c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89c03b90154c4b4aaab4f002b66c0a68', 'request_id': 'req-d3defaa1-2f16-4576-9fa0-723934eaa6c7'} {{(pid=87209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 21:30:34.091208 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.notifications [None req-d3defaa1-2f16-4576-9fa0-723934eaa6c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89c03b90154c4b4aaab4f002b66c0a68', 'request_id': 'req-d3defaa1-2f16-4576-9fa0-723934eaa6c7'} {{(pid=87209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 21:30:34.111975 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.notifications [None req-d3defaa1-2f16-4576-9fa0-723934eaa6c7 admin admin] The token cache is being invalidate because project 89c03b90154c4b4aaab4f002b66c0a68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 21:30:34.112594 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.notifications [None req-d3defaa1-2f16-4576-9fa0-723934eaa6c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 21:30:34.113393 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.notifications [None req-d3defaa1-2f16-4576-9fa0-723934eaa6c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 21:30:34.115265 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 576/1127] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Jul 25 21:30:33 2022] DELETE /identity/v3/projects/89c03b90154c4b4aaab4f002b66c0a68 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 21:30:43.570944 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=25 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:30:44.107704 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:31:58.770728 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6956569f-3e9b-439c-a657-fd1e9053186a None None] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:31:58.771368 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6956569f-3e9b-439c-a657-fd1e9053186a None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:31:58.771368 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6956569f-3e9b-439c-a657-fd1e9053186a None None] PATH_INFO: `/` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:31:58.773067 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 552/1128] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 21:31:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:31:58.780025 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d236b19e-8ca4-43d2-bfb6-c892a14fe4ec None None] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:31:58.780477 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d236b19e-8ca4-43d2-bfb6-c892a14fe4ec None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:31:58.780595 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d236b19e-8ca4-43d2-bfb6-c892a14fe4ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:31:58.859748 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.auth.core [None req-d236b19e-8ca4-43d2-bfb6-c892a14fe4ec None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:31:58.860956 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-d236b19e-8ca4-43d2-bfb6-c892a14fe4ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:31:58.959296 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 577/1129] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 21:31:58 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:31:59.123633 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6956569f-3e9b-439c-a657-fd1e9053186a None None] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:31:59.126743 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.fernet_utils [None req-6956569f-3e9b-439c-a657-fd1e9053186a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:31:59.229473 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6956569f-3e9b-439c-a657-fd1e9053186a None None] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:31:59.235409 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d275bad-03da-4a51-941e-e4c7b37ec42f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '524584f0d1b64e02a467b47de395c130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e36d923af474a07adb12209580f12e1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:31:59.236033 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d275bad-03da-4a51-941e-e4c7b37ec42f service nova] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:31:59.236312 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d275bad-03da-4a51-941e-e4c7b37ec42f service nova] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:31:59.236590 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d275bad-03da-4a51-941e-e4c7b37ec42f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:31:59.245559 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d275bad-03da-4a51-941e-e4c7b37ec42f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:31:59.247456 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d275bad-03da-4a51-941e-e4c7b37ec42f service nova] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:31:59.257290 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 553/1130] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 25 21:31:59 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:32:00.098259 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf6760a-3b2d-4e1c-a9c9-61bbe43bb7c1 None None] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:32:00.098858 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf6760a-3b2d-4e1c-a9c9-61bbe43bb7c1 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:32:00.098858 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf6760a-3b2d-4e1c-a9c9-61bbe43bb7c1 None None] PATH_INFO: `/` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:32:00.100190 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 578/1131] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 21:32:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:32:00.106625 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b508981f-693b-4957-bc41-949e453a4d2c None None] REQUEST_METHOD: `POST` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:32:00.107362 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b508981f-693b-4957-bc41-949e453a4d2c None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:32:00.107498 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b508981f-693b-4957-bc41-949e453a4d2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:32:00.137122 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.auth.core [None req-b508981f-693b-4957-bc41-949e453a4d2c None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:32:00.138380 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.fernet_utils [None req-b508981f-693b-4957-bc41-949e453a4d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:32:00.146784 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 554/1132] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 21:32:00 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:32:00.306959 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf6760a-3b2d-4e1c-a9c9-61bbe43bb7c1 None None] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:32:00.330468 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf6760a-3b2d-4e1c-a9c9-61bbe43bb7c1 None None] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:32:00.339090 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae54dc91-a5ea-45ed-847b-468d4581cd87 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '524584f0d1b64e02a467b47de395c130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e36d923af474a07adb12209580f12e1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:32:00.339749 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae54dc91-a5ea-45ed-847b-468d4581cd87 service nova] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:32:00.340033 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae54dc91-a5ea-45ed-847b-468d4581cd87 service nova] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:32:00.340315 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae54dc91-a5ea-45ed-847b-468d4581cd87 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:32:00.349368 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae54dc91-a5ea-45ed-847b-468d4581cd87 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:32:00.351000 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae54dc91-a5ea-45ed-847b-468d4581cd87 service nova] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:32:00.361712 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 579/1133] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 25 21:32:00 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:32:04.406212 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5729b9-deb3-4f0c-bfb3-8cc0f1f8c922 None None] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:32:04.406784 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5729b9-deb3-4f0c-bfb3-8cc0f1f8c922 None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:32:04.406784 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5729b9-deb3-4f0c-bfb3-8cc0f1f8c922 None None] PATH_INFO: `/v3` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:32:04.408692 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 555/1134] 10.222.0.81 () {54 vars in 925 bytes} [Mon Jul 25 21:32:04 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:32:04.416245 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b296d20-82fd-426b-8d8f-88a2f2bbf922 None None] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:32:04.416678 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b296d20-82fd-426b-8d8f-88a2f2bbf922 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:32:04.416795 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b296d20-82fd-426b-8d8f-88a2f2bbf922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:32:04.457876 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.auth.core [None req-5b296d20-82fd-426b-8d8f-88a2f2bbf922 None None] MFA Rules not processed for user `3e0e5ab2acc3425c9d820f2027f5652b`. Rule list: `[]` (Enabled: `True`). {{(pid=87209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:32:04.459551 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-5b296d20-82fd-426b-8d8f-88a2f2bbf922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:32:04.521543 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=100 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:32:04.533351 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 580/1135] 10.222.0.81 () {58 vars in 1015 bytes} [Mon Jul 25 21:32:04 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:32:08.646447 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5244a53f-362a-43ac-8638-6cedaa7d9754 None None] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:32:08.647027 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5244a53f-362a-43ac-8638-6cedaa7d9754 None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:32:08.647027 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5244a53f-362a-43ac-8638-6cedaa7d9754 None None] PATH_INFO: `/` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:32:08.648247 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 556/1136] 10.222.0.66 () {54 vars in 961 bytes} [Mon Jul 25 21:32:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:32:08.654650 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4868a6bd-aaa4-4c30-80f3-2c285332cb4e None None] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:32:08.655426 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4868a6bd-aaa4-4c30-80f3-2c285332cb4e None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:32:08.655536 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4868a6bd-aaa4-4c30-80f3-2c285332cb4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:32:08.679480 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.auth.core [None req-4868a6bd-aaa4-4c30-80f3-2c285332cb4e None None] MFA Rules not processed for user `3e0e5ab2acc3425c9d820f2027f5652b`. Rule list: `[]` (Enabled: `True`). {{(pid=87209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:32:08.680696 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-4868a6bd-aaa4-4c30-80f3-2c285332cb4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:32:08.691550 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 581/1137] 10.222.0.66 () {58 vars in 1058 bytes} [Mon Jul 25 21:32:08 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:32:08.699608 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5244a53f-362a-43ac-8638-6cedaa7d9754 None None] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:32:08.715976 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5244a53f-362a-43ac-8638-6cedaa7d9754 None None] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:32:08.722799 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbf893c-3b80-418d-b70c-e9e98c10d313 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e0e5ab2acc3425c9d820f2027f5652b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e36d923af474a07adb12209580f12e1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:32:08.723430 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbf893c-3b80-418d-b70c-e9e98c10d313 service placement] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:32:08.723707 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbf893c-3b80-418d-b70c-e9e98c10d313 service placement] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:32:08.723974 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbf893c-3b80-418d-b70c-e9e98c10d313 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:32:08.733545 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbf893c-3b80-418d-b70c-e9e98c10d313 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:32:08.735276 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbf893c-3b80-418d-b70c-e9e98c10d313 service placement] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:32:08.745371 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 557/1138] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 25 21:32:08 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:32:11.632958 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de59e778-9cb0-4742-a5d6-7d588a3c0227 None None] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:32:11.633868 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de59e778-9cb0-4742-a5d6-7d588a3c0227 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:32:11.633868 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de59e778-9cb0-4742-a5d6-7d588a3c0227 None None] PATH_INFO: `/` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:32:11.636034 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 582/1139] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 21:32:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:32:11.645325 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625665a9-2598-46ac-8b2c-40eb2f2fd054 None None] REQUEST_METHOD: `POST` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:32:11.646060 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625665a9-2598-46ac-8b2c-40eb2f2fd054 None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:32:11.646233 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625665a9-2598-46ac-8b2c-40eb2f2fd054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:32:11.672527 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.auth.core [None req-625665a9-2598-46ac-8b2c-40eb2f2fd054 None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:32:11.673819 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.fernet_utils [None req-625665a9-2598-46ac-8b2c-40eb2f2fd054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:32:11.682696 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 558/1140] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 21:32:11 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:32:11.848167 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de59e778-9cb0-4742-a5d6-7d588a3c0227 None None] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:32:11.869220 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de59e778-9cb0-4742-a5d6-7d588a3c0227 None None] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:32:11.876425 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7931615d-0c3a-4af7-a693-58c245536cef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '524584f0d1b64e02a467b47de395c130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e36d923af474a07adb12209580f12e1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:32:11.877074 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7931615d-0c3a-4af7-a693-58c245536cef service nova] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:32:11.877622 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7931615d-0c3a-4af7-a693-58c245536cef service nova] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:32:11.877901 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7931615d-0c3a-4af7-a693-58c245536cef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:32:11.886947 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7931615d-0c3a-4af7-a693-58c245536cef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:32:11.888533 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7931615d-0c3a-4af7-a693-58c245536cef service nova] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:32:11.900232 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 583/1141] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 25 21:32:11 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:32:12.734868 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb78b2f-3316-4a75-9fc1-272e19f24db3 None None] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:32:12.735786 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb78b2f-3316-4a75-9fc1-272e19f24db3 None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:32:12.735786 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb78b2f-3316-4a75-9fc1-272e19f24db3 None None] PATH_INFO: `/` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:32:12.737448 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 559/1142] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 21:32:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:32:12.743122 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd20f525-3d4d-45c2-a4e2-134e45266652 None None] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:32:12.743599 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd20f525-3d4d-45c2-a4e2-134e45266652 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:32:12.743698 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd20f525-3d4d-45c2-a4e2-134e45266652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:32:12.772307 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.auth.core [None req-bd20f525-3d4d-45c2-a4e2-134e45266652 None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:32:12.776863 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-bd20f525-3d4d-45c2-a4e2-134e45266652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:32:12.786624 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 584/1143] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 21:32:12 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:32:12.948586 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb78b2f-3316-4a75-9fc1-272e19f24db3 None None] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:32:12.964942 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb78b2f-3316-4a75-9fc1-272e19f24db3 None None] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:32:12.971320 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e517816-e4ec-488a-90c4-64e84a954594 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '524584f0d1b64e02a467b47de395c130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e36d923af474a07adb12209580f12e1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:32:12.971947 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e517816-e4ec-488a-90c4-64e84a954594 service nova] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:32:12.972226 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e517816-e4ec-488a-90c4-64e84a954594 service nova] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:32:12.972491 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e517816-e4ec-488a-90c4-64e84a954594 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:32:12.981320 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e517816-e4ec-488a-90c4-64e84a954594 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:32:12.982896 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e517816-e4ec-488a-90c4-64e84a954594 service nova] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:32:12.992376 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 560/1144] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 25 21:32:12 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:32:17.452534 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fa8af3-8253-4f1d-95cd-99cb1d7c251d None None] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:32:17.453173 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fa8af3-8253-4f1d-95cd-99cb1d7c251d None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:32:17.453173 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fa8af3-8253-4f1d-95cd-99cb1d7c251d None None] PATH_INFO: `/` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:32:17.454481 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 585/1145] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 21:32:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:32:17.461121 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24119253-68b5-41f7-84c7-54c485b660d4 None None] REQUEST_METHOD: `POST` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:32:17.461909 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24119253-68b5-41f7-84c7-54c485b660d4 None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:32:17.461909 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24119253-68b5-41f7-84c7-54c485b660d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:32:17.486218 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.auth.core [None req-24119253-68b5-41f7-84c7-54c485b660d4 None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:32:17.487416 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.fernet_utils [None req-24119253-68b5-41f7-84c7-54c485b660d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:32:17.496695 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 561/1146] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 21:32:17 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:32:17.536754 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fa8af3-8253-4f1d-95cd-99cb1d7c251d None None] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:32:17.539658 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-e9fa8af3-8253-4f1d-95cd-99cb1d7c251d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:32:17.617143 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fa8af3-8253-4f1d-95cd-99cb1d7c251d None None] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:32:17.621477 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ef7718-2fd7-4c9d-ac9a-c9504fbe7490 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '704ea1ca162d4df3ab560d910d599851', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e36d923af474a07adb12209580f12e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:32:17.622112 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ef7718-2fd7-4c9d-ac9a-c9504fbe7490 service neutron] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:32:17.622393 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ef7718-2fd7-4c9d-ac9a-c9504fbe7490 service neutron] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:32:17.622669 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ef7718-2fd7-4c9d-ac9a-c9504fbe7490 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:32:17.632727 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ef7718-2fd7-4c9d-ac9a-c9504fbe7490 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:32:17.634240 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ef7718-2fd7-4c9d-ac9a-c9504fbe7490 service neutron] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:32:17.644241 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 586/1147] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 25 21:32:17 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:32:19.869767 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1f72b2-cbad-4af1-b724-4919cdd28be8 None None] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:32:19.870353 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1f72b2-cbad-4af1-b724-4919cdd28be8 None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:32:19.870353 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1f72b2-cbad-4af1-b724-4919cdd28be8 None None] PATH_INFO: `/` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:32:19.871719 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 562/1148] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 21:32:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:32:19.877393 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdfbfce-e990-4f1a-898e-72b8f809ca04 None None] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:32:19.877824 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdfbfce-e990-4f1a-898e-72b8f809ca04 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:32:19.877936 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdfbfce-e990-4f1a-898e-72b8f809ca04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:32:20.032458 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.auth.core [None req-4fdfbfce-e990-4f1a-898e-72b8f809ca04 None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:32:20.033746 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-4fdfbfce-e990-4f1a-898e-72b8f809ca04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:32:20.043156 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 587/1149] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 21:32:19 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:32:20.085726 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1f72b2-cbad-4af1-b724-4919cdd28be8 None None] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:32:20.099535 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1f72b2-cbad-4af1-b724-4919cdd28be8 None None] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:32:20.103793 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb64f12-c213-4d6b-ae8a-2ccfab0faf4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '704ea1ca162d4df3ab560d910d599851', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e36d923af474a07adb12209580f12e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:32:20.104402 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb64f12-c213-4d6b-ae8a-2ccfab0faf4e service neutron] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:32:20.104688 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb64f12-c213-4d6b-ae8a-2ccfab0faf4e service neutron] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:32:20.104953 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb64f12-c213-4d6b-ae8a-2ccfab0faf4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:32:20.114846 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb64f12-c213-4d6b-ae8a-2ccfab0faf4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:32:20.116287 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb64f12-c213-4d6b-ae8a-2ccfab0faf4e service neutron] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:32:20.126654 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 563/1150] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 25 21:32:20 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:32:23.878483 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edc1c2f-2320-4a4c-8a9a-d72e8259a4a5 None None] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:32:23.879095 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edc1c2f-2320-4a4c-8a9a-d72e8259a4a5 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:32:23.879095 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edc1c2f-2320-4a4c-8a9a-d72e8259a4a5 None None] PATH_INFO: `/` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:32:23.880416 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 588/1151] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 21:32:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:32:23.889562 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3207580-ff31-496d-9aa7-8096c52ee0cf None None] REQUEST_METHOD: `POST` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:32:23.890304 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3207580-ff31-496d-9aa7-8096c52ee0cf None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:32:23.890494 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3207580-ff31-496d-9aa7-8096c52ee0cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:32:23.900101 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=67 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:32:23.914263 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.auth.core [None req-f3207580-ff31-496d-9aa7-8096c52ee0cf None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:32:23.915508 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.fernet_utils [None req-f3207580-ff31-496d-9aa7-8096c52ee0cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:32:23.924049 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 564/1152] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 21:32:23 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:32:24.206779 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edc1c2f-2320-4a4c-8a9a-d72e8259a4a5 None None] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:32:24.208832 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-7edc1c2f-2320-4a4c-8a9a-d72e8259a4a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:32:24.273037 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edc1c2f-2320-4a4c-8a9a-d72e8259a4a5 None None] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:32:24.277486 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7273f01e-0115-44fd-afb2-9d1ad96a3164 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36a8b42b275490d8f7fbd4e16f398fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e36d923af474a07adb12209580f12e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:32:24.278104 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7273f01e-0115-44fd-afb2-9d1ad96a3164 service cinder] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:32:24.278381 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7273f01e-0115-44fd-afb2-9d1ad96a3164 service cinder] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:32:24.278651 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7273f01e-0115-44fd-afb2-9d1ad96a3164 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:32:24.289604 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7273f01e-0115-44fd-afb2-9d1ad96a3164 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:32:24.291048 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7273f01e-0115-44fd-afb2-9d1ad96a3164 service cinder] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:32:24.301196 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 589/1153] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 25 21:32:24 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 21:32:26.568443 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938da108-dd77-434e-a16a-088a487a2398 None None] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:32:26.569003 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938da108-dd77-434e-a16a-088a487a2398 None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:32:26.569003 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938da108-dd77-434e-a16a-088a487a2398 None None] PATH_INFO: `/` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:32:26.570390 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 565/1154] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 21:32:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:32:26.575597 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dc7716-0e54-4775-a951-24c03d6912ac None None] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:32:26.576065 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dc7716-0e54-4775-a951-24c03d6912ac None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:32:26.576171 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dc7716-0e54-4775-a951-24c03d6912ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:32:26.596201 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.auth.core [None req-88dc7716-0e54-4775-a951-24c03d6912ac None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:32:26.597454 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-88dc7716-0e54-4775-a951-24c03d6912ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:32:26.605400 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 590/1155] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 21:32:26 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:32:26.881408 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938da108-dd77-434e-a16a-088a487a2398 None None] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:32:26.884726 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.fernet_utils [None req-938da108-dd77-434e-a16a-088a487a2398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:32:26.900727 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938da108-dd77-434e-a16a-088a487a2398 None None] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:32:26.904647 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702acef4-48a8-462c-8ecc-d48fa3dcc74a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36a8b42b275490d8f7fbd4e16f398fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e36d923af474a07adb12209580f12e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:32:26.905290 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702acef4-48a8-462c-8ecc-d48fa3dcc74a service cinder] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:32:26.905569 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702acef4-48a8-462c-8ecc-d48fa3dcc74a service cinder] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:32:26.905842 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702acef4-48a8-462c-8ecc-d48fa3dcc74a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:32:26.915489 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702acef4-48a8-462c-8ecc-d48fa3dcc74a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:32:26.916912 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702acef4-48a8-462c-8ecc-d48fa3dcc74a service cinder] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:32:26.926491 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 566/1156] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 25 21:32:26 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:32:36.590747 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=70 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:32:36.922630 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=8 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:33:46.652058 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ab1789-0dc5-4932-8522-4ee5a453b402 None None] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:33:46.652727 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ab1789-0dc5-4932-8522-4ee5a453b402 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:33:46.652727 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ab1789-0dc5-4932-8522-4ee5a453b402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:33:46.671912 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfd8582-3d90-4dc2-9665-bb2da7800f1c None None] REQUEST_METHOD: `POST` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:33:46.672520 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfd8582-3d90-4dc2-9665-bb2da7800f1c None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:33:46.672520 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfd8582-3d90-4dc2-9665-bb2da7800f1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:33:46.675514 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.auth.core [None req-f2ab1789-0dc5-4932-8522-4ee5a453b402 None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:33:46.676760 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-f2ab1789-0dc5-4932-8522-4ee5a453b402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:33:46.685621 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 591/1157] 10.222.0.66 () {58 vars in 958 bytes} [Mon Jul 25 21:33:46 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:33:46.692099 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.auth.core [None req-1bfd8582-3d90-4dc2-9665-bb2da7800f1c None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:33:46.693339 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.fernet_utils [None req-1bfd8582-3d90-4dc2-9665-bb2da7800f1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:33:46.693914 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79000e12-3b60-47c2-af3e-293783edc2c5 None None] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:33:46.694203 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79000e12-3b60-47c2-af3e-293783edc2c5 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:33:46.694453 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79000e12-3b60-47c2-af3e-293783edc2c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:33:46.701678 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 567/1158] 10.222.0.66 () {58 vars in 958 bytes} [Mon Jul 25 21:33:46 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 21:33:46.709908 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054c92e6-ae38-4cf4-b165-2cabd221f492 None None] REQUEST_METHOD: `POST` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:33:46.710157 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054c92e6-ae38-4cf4-b165-2cabd221f492 None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:33:46.710473 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054c92e6-ae38-4cf4-b165-2cabd221f492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:33:46.714222 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.auth.core [None req-79000e12-3b60-47c2-af3e-293783edc2c5 None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:33:46.715423 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-79000e12-3b60-47c2-af3e-293783edc2c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:33:46.724000 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 592/1159] 10.222.0.66 () {58 vars in 958 bytes} [Mon Jul 25 21:33:46 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 21:33:46.728542 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79000e12-3b60-47c2-af3e-293783edc2c5 None None] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:33:46.730654 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.auth.core [None req-054c92e6-ae38-4cf4-b165-2cabd221f492 None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:33:46.731826 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.fernet_utils [None req-054c92e6-ae38-4cf4-b165-2cabd221f492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:33:46.737680 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79000e12-3b60-47c2-af3e-293783edc2c5 None None] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:33:46.740088 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 568/1160] 10.222.0.66 () {58 vars in 958 bytes} [Mon Jul 25 21:33:46 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 21:33:46.742258 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebda2ca5-edff-4cbc-91d3-51d8e7268158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9501d798e8481da3be76351eec2bf6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:33:46.742865 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebda2ca5-edff-4cbc-91d3-51d8e7268158 admin admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:33:46.743143 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebda2ca5-edff-4cbc-91d3-51d8e7268158 admin admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:33:46.743613 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebda2ca5-edff-4cbc-91d3-51d8e7268158 admin admin] PATH_INFO: `/v3/domains` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:33:46.744098 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebda2ca5-edff-4cbc-91d3-51d8e7268158 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:33:46.744394 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebda2ca5-edff-4cbc-91d3-51d8e7268158 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:33:46.744499 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054c92e6-ae38-4cf4-b165-2cabd221f492 None None] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:33:46.746097 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebda2ca5-edff-4cbc-91d3-51d8e7268158 admin admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:33:46.753377 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054c92e6-ae38-4cf4-b165-2cabd221f492 None None] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:33:46.757890 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 593/1161] 10.222.0.66 () {58 vars in 1153 bytes} [Mon Jul 25 21:33:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:33:46.758117 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0005cbe2-ef44-4f8a-8404-a2bb5c81eed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9501d798e8481da3be76351eec2bf6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:33:46.758603 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0005cbe2-ef44-4f8a-8404-a2bb5c81eed8 admin admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:33:46.758871 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0005cbe2-ef44-4f8a-8404-a2bb5c81eed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:33:46.759135 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0005cbe2-ef44-4f8a-8404-a2bb5c81eed8 admin admin] PATH_INFO: `/v3/domains` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:33:46.759813 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0005cbe2-ef44-4f8a-8404-a2bb5c81eed8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:33:46.760115 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0005cbe2-ef44-4f8a-8404-a2bb5c81eed8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:33:46.761452 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: WARNING py.warnings [None req-0005cbe2-ef44-4f8a-8404-a2bb5c81eed8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 21:33:46.761452 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: warnings.warn(msg) Jul 25 21:33:46.761452 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: Jul 25 21:33:46.762341 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0005cbe2-ef44-4f8a-8404-a2bb5c81eed8 admin admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:33:46.765826 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebda2ca5-edff-4cbc-91d3-51d8e7268158 admin admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:33:46.774420 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 569/1162] 10.222.0.66 () {58 vars in 1153 bytes} [Mon Jul 25 21:33:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:33:46.779854 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebda2ca5-edff-4cbc-91d3-51d8e7268158 admin admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:33:46.783052 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0005cbe2-ef44-4f8a-8404-a2bb5c81eed8 admin admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:33:46.785527 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a473eb-e751-41a7-9096-3adf748442b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9501d798e8481da3be76351eec2bf6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:33:46.786155 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a473eb-e751-41a7-9096-3adf748442b8 admin admin] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:33:46.786435 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a473eb-e751-41a7-9096-3adf748442b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:33:46.786713 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a473eb-e751-41a7-9096-3adf748442b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:33:46.787381 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a473eb-e751-41a7-9096-3adf748442b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:33:46.788403 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: WARNING py.warnings [None req-b7a473eb-e751-41a7-9096-3adf748442b8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 21:33:46.788403 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: warnings.warn(msg) Jul 25 21:33:46.788403 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: Jul 25 21:33:46.789615 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a473eb-e751-41a7-9096-3adf748442b8 admin admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:33:46.792876 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0005cbe2-ef44-4f8a-8404-a2bb5c81eed8 admin admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:33:46.797454 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe493ea0-5ba2-40e5-8780-eb9e85b015b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9501d798e8481da3be76351eec2bf6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:33:46.798061 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe493ea0-5ba2-40e5-8780-eb9e85b015b8 admin admin] REQUEST_METHOD: `POST` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:33:46.798333 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe493ea0-5ba2-40e5-8780-eb9e85b015b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:33:46.798594 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe493ea0-5ba2-40e5-8780-eb9e85b015b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:33:46.799246 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe493ea0-5ba2-40e5-8780-eb9e85b015b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:33:46.801145 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe493ea0-5ba2-40e5-8780-eb9e85b015b8 admin admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:33:46.828454 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 594/1163] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Jul 25 21:33:46 2022] POST /identity/v3/projects => generated 377 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 21:33:46.831093 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 570/1164] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Jul 25 21:33:46 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 21:33:46.834800 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a473eb-e751-41a7-9096-3adf748442b8 admin admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:33:46.834945 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe493ea0-5ba2-40e5-8780-eb9e85b015b8 admin admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:33:46.900714 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a473eb-e751-41a7-9096-3adf748442b8 admin admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:33:46.967081 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0d230f-f037-47d5-929e-f80ce73dfec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9501d798e8481da3be76351eec2bf6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:33:46.967738 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0d230f-f037-47d5-929e-f80ce73dfec1 admin admin] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:33:46.968014 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0d230f-f037-47d5-929e-f80ce73dfec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:33:46.968280 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0d230f-f037-47d5-929e-f80ce73dfec1 admin admin] PATH_INFO: `/v3/users` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:33:46.968950 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0d230f-f037-47d5-929e-f80ce73dfec1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:33:46.970947 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0d230f-f037-47d5-929e-f80ce73dfec1 admin admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:33:46.995665 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 595/1165] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Jul 25 21:33:46 2022] POST /identity/v3/users => generated 289 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 21:33:46.999515 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0d230f-f037-47d5-929e-f80ce73dfec1 admin admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:33:47.009645 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0d230f-f037-47d5-929e-f80ce73dfec1 admin admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:33:47.014688 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2664e2f9-2ef7-4850-8269-ba879a8d88fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9501d798e8481da3be76351eec2bf6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:33:47.015308 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2664e2f9-2ef7-4850-8269-ba879a8d88fe admin admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:33:47.015590 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2664e2f9-2ef7-4850-8269-ba879a8d88fe admin admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:33:47.015865 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2664e2f9-2ef7-4850-8269-ba879a8d88fe admin admin] PATH_INFO: `/v3/roles` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:33:47.016555 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2664e2f9-2ef7-4850-8269-ba879a8d88fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:33:47.018203 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2664e2f9-2ef7-4850-8269-ba879a8d88fe admin admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:33:47.028706 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 596/1166] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Jul 25 21:33:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 21:33:47.029293 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe493ea0-5ba2-40e5-8780-eb9e85b015b8 admin admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:33:47.032992 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2664e2f9-2ef7-4850-8269-ba879a8d88fe admin admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:33:47.034522 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50f567c-e785-4d2b-aae5-11d55ef61180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9501d798e8481da3be76351eec2bf6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:33:47.035150 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50f567c-e785-4d2b-aae5-11d55ef61180 admin admin] REQUEST_METHOD: `POST` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:33:47.035423 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50f567c-e785-4d2b-aae5-11d55ef61180 admin admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:33:47.035689 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50f567c-e785-4d2b-aae5-11d55ef61180 admin admin] PATH_INFO: `/v3/users` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:33:47.036350 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50f567c-e785-4d2b-aae5-11d55ef61180 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:33:47.037549 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: WARNING py.warnings [None req-b50f567c-e785-4d2b-aae5-11d55ef61180 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 21:33:47.037549 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: warnings.warn(msg) Jul 25 21:33:47.037549 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: Jul 25 21:33:47.038899 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50f567c-e785-4d2b-aae5-11d55ef61180 admin admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:33:47.043192 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2664e2f9-2ef7-4850-8269-ba879a8d88fe admin admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:33:47.047862 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f7fd8c-783f-4c21-9e2f-93ed6b0295f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9501d798e8481da3be76351eec2bf6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:33:47.048475 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f7fd8c-783f-4c21-9e2f-93ed6b0295f3 admin admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:33:47.048757 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f7fd8c-783f-4c21-9e2f-93ed6b0295f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:33:47.049033 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f7fd8c-783f-4c21-9e2f-93ed6b0295f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:33:47.049767 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f7fd8c-783f-4c21-9e2f-93ed6b0295f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:33:47.051881 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f7fd8c-783f-4c21-9e2f-93ed6b0295f3 admin admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:33:47.062430 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 597/1167] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Jul 25 21:33:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 21:33:47.065958 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 571/1168] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Jul 25 21:33:46 2022] POST /identity/v3/users => generated 293 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 21:33:47.066961 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f7fd8c-783f-4c21-9e2f-93ed6b0295f3 admin admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:33:47.067200 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50f567c-e785-4d2b-aae5-11d55ef61180 admin admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:33:47.076706 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f7fd8c-783f-4c21-9e2f-93ed6b0295f3 admin admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:33:47.079726 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50f567c-e785-4d2b-aae5-11d55ef61180 admin admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:33:47.081572 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff20cdc0-ac27-411e-88fd-5ff1d714aeec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9501d798e8481da3be76351eec2bf6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:33:47.082252 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff20cdc0-ac27-411e-88fd-5ff1d714aeec admin admin] REQUEST_METHOD: `PUT` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:33:47.082532 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff20cdc0-ac27-411e-88fd-5ff1d714aeec admin admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:33:47.082883 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff20cdc0-ac27-411e-88fd-5ff1d714aeec admin admin] PATH_INFO: `/v3/projects/d588a38c62e7412e84b10df904a6faee/users/b248db46f9ef442ebf585f91397e71c3/roles/faec70ea0ba040efa587f542f054e49e` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:33:47.085319 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef49645d-8602-4045-8b5c-bcd4b89c7be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9501d798e8481da3be76351eec2bf6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:33:47.085993 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef49645d-8602-4045-8b5c-bcd4b89c7be3 admin admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:33:47.086299 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef49645d-8602-4045-8b5c-bcd4b89c7be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:33:47.086620 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef49645d-8602-4045-8b5c-bcd4b89c7be3 admin admin] PATH_INFO: `/v3/roles` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:33:47.087381 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef49645d-8602-4045-8b5c-bcd4b89c7be3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:33:47.089484 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef49645d-8602-4045-8b5c-bcd4b89c7be3 admin admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:33:47.098312 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff20cdc0-ac27-411e-88fd-5ff1d714aeec admin admin] RBAC: Authorizing `identity:create_grant(project_id=d588a38c62e7412e84b10df904a6faee, user_id=b248db46f9ef442ebf585f91397e71c3, role_id=faec70ea0ba040efa587f542f054e49e)` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:33:47.099349 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: WARNING py.warnings [None req-ff20cdc0-ac27-411e-88fd-5ff1d714aeec admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 21:33:47.099349 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: warnings.warn(msg) Jul 25 21:33:47.099349 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: Jul 25 21:33:47.100734 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 572/1169] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Jul 25 21:33:47 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 21:33:47.101329 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff20cdc0-ac27-411e-88fd-5ff1d714aeec admin admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:33:47.103588 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:33:47.105133 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef49645d-8602-4045-8b5c-bcd4b89c7be3 admin admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:33:47.116592 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef49645d-8602-4045-8b5c-bcd4b89c7be3 admin admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:33:47.117846 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 598/1170] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Jul 25 21:33:47 2022] PUT /identity/v3/projects/d588a38c62e7412e84b10df904a6faee/users/b248db46f9ef442ebf585f91397e71c3/roles/faec70ea0ba040efa587f542f054e49e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 21:33:47.123103 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae6ec46-cd37-4245-8878-5e10b934c36b None None] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:33:47.123386 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae6ec46-cd37-4245-8878-5e10b934c36b None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:33:47.123658 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae6ec46-cd37-4245-8878-5e10b934c36b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:33:47.144682 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.auth.core [None req-2ae6ec46-cd37-4245-8878-5e10b934c36b None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:33:47.145974 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-2ae6ec46-cd37-4245-8878-5e10b934c36b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:33:47.187665 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517cd7d1-9236-4a27-8306-4b9586d13c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9501d798e8481da3be76351eec2bf6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:33:47.188294 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517cd7d1-9236-4a27-8306-4b9586d13c90 admin admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:33:47.188566 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517cd7d1-9236-4a27-8306-4b9586d13c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:33:47.188827 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517cd7d1-9236-4a27-8306-4b9586d13c90 admin admin] PATH_INFO: `/v3/roles` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:33:47.189535 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517cd7d1-9236-4a27-8306-4b9586d13c90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:33:47.191136 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517cd7d1-9236-4a27-8306-4b9586d13c90 admin admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:33:47.201279 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 573/1171] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Jul 25 21:33:47 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 21:33:47.205435 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517cd7d1-9236-4a27-8306-4b9586d13c90 admin admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:33:47.215110 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 599/1172] 10.222.0.66 () {58 vars in 958 bytes} [Mon Jul 25 21:33:47 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 21:33:47.215374 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517cd7d1-9236-4a27-8306-4b9586d13c90 admin admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:33:47.221889 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72fab19-ff91-4cd1-ba17-75e3d480d5f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9501d798e8481da3be76351eec2bf6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:33:47.222559 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72fab19-ff91-4cd1-ba17-75e3d480d5f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:33:47.222835 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72fab19-ff91-4cd1-ba17-75e3d480d5f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:33:47.223105 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72fab19-ff91-4cd1-ba17-75e3d480d5f0 admin admin] PATH_INFO: `/v3/projects/a1d99d0047bd448d8281167c8f16e052/users/b0142184cb824ec9840066ed12f7f27b/roles/faec70ea0ba040efa587f542f054e49e` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:33:47.225189 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae6ec46-cd37-4245-8878-5e10b934c36b None None] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:33:47.239452 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72fab19-ff91-4cd1-ba17-75e3d480d5f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1d99d0047bd448d8281167c8f16e052, user_id=b0142184cb824ec9840066ed12f7f27b, role_id=faec70ea0ba040efa587f542f054e49e)` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:33:47.242169 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72fab19-ff91-4cd1-ba17-75e3d480d5f0 admin admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:33:47.258380 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 574/1173] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Jul 25 21:33:47 2022] PUT /identity/v3/projects/a1d99d0047bd448d8281167c8f16e052/users/b0142184cb824ec9840066ed12f7f27b/roles/faec70ea0ba040efa587f542f054e49e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 21:33:47.264133 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc8d414-cfbb-4b51-860b-d7bacee141fb None None] REQUEST_METHOD: `POST` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:33:47.264422 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc8d414-cfbb-4b51-860b-d7bacee141fb None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:33:47.264690 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc8d414-cfbb-4b51-860b-d7bacee141fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:33:47.272487 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:33:47.285388 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae6ec46-cd37-4245-8878-5e10b934c36b None None] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:33:47.285795 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.auth.core [None req-bcc8d414-cfbb-4b51-860b-d7bacee141fb None None] MFA Rules not processed for user `1e6cadb2f0fe422088a106e6a578b2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:33:47.287015 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.fernet_utils [None req-bcc8d414-cfbb-4b51-860b-d7bacee141fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:33:47.336867 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f93b4b1-7cbd-417f-a683-607303403778 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '704ea1ca162d4df3ab560d910d599851', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e36d923af474a07adb12209580f12e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:33:47.337523 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f93b4b1-7cbd-417f-a683-607303403778 service neutron] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:33:47.337849 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f93b4b1-7cbd-417f-a683-607303403778 service neutron] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:33:47.338091 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f93b4b1-7cbd-417f-a683-607303403778 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:33:47.352462 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 575/1174] 10.222.0.66 () {58 vars in 958 bytes} [Mon Jul 25 21:33:47 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:33:47.363317 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc8d414-cfbb-4b51-860b-d7bacee141fb None None] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:33:47.373585 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc8d414-cfbb-4b51-860b-d7bacee141fb None None] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:33:47.377598 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b798868-6b81-439e-87e0-bbf79833e18e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '704ea1ca162d4df3ab560d910d599851', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e36d923af474a07adb12209580f12e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:33:47.378216 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b798868-6b81-439e-87e0-bbf79833e18e service neutron] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:33:47.378489 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b798868-6b81-439e-87e0-bbf79833e18e service neutron] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:33:47.378755 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b798868-6b81-439e-87e0-bbf79833e18e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:33:47.388173 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b798868-6b81-439e-87e0-bbf79833e18e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:33:47.390274 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b798868-6b81-439e-87e0-bbf79833e18e service neutron] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:33:47.400208 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 576/1175] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 25 21:33:47 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:33:47.404978 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f93b4b1-7cbd-417f-a683-607303403778 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:33:47.406827 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f93b4b1-7cbd-417f-a683-607303403778 service neutron] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:33:47.412040 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:33:47.417598 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 600/1176] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 25 21:33:47 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 21:33:52.465887 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47c76e0-8349-4f03-a65c-538d057d6e81 None None] REQUEST_METHOD: `POST` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:33:52.466467 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47c76e0-8349-4f03-a65c-538d057d6e81 None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:33:52.466467 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47c76e0-8349-4f03-a65c-538d057d6e81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:33:52.524154 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.auth.core [None req-b47c76e0-8349-4f03-a65c-538d057d6e81 None None] MFA Rules not processed for user `b248db46f9ef442ebf585f91397e71c3`. Rule list: `[]` (Enabled: `True`). {{(pid=87210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:33:52.525415 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.fernet_utils [None req-b47c76e0-8349-4f03-a65c-538d057d6e81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:33:52.660687 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 577/1177] 10.222.0.66 () {58 vars in 958 bytes} [Mon Jul 25 21:33:52 2022] POST /identity/v3/auth/tokens => generated 2804 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:33:52.665361 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f93b4b1-7cbd-417f-a683-607303403778 service neutron] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:33:52.678045 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f93b4b1-7cbd-417f-a683-607303403778 service neutron] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:33:52.684460 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c11898-9565-4007-8da8-55cdd35b71eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9501d798e8481da3be76351eec2bf6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:33:52.684997 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c11898-9565-4007-8da8-55cdd35b71eb admin admin] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:33:52.685618 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c11898-9565-4007-8da8-55cdd35b71eb admin admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:33:52.685618 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c11898-9565-4007-8da8-55cdd35b71eb admin admin] PATH_INFO: `/v3/projects` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:33:52.686527 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c11898-9565-4007-8da8-55cdd35b71eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:33:52.688551 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c11898-9565-4007-8da8-55cdd35b71eb admin admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:33:52.758854 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 601/1178] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Jul 25 21:33:52 2022] POST /identity/v3/projects => generated 379 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 21:33:52.760761 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47c76e0-8349-4f03-a65c-538d057d6e81 None None] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:33:52.780293 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47c76e0-8349-4f03-a65c-538d057d6e81 None None] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:33:52.857914 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9fbd6f-0e65-4711-b39a-412ca01cbd33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9501d798e8481da3be76351eec2bf6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:33:52.857914 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9fbd6f-0e65-4711-b39a-412ca01cbd33 admin admin] REQUEST_METHOD: `POST` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:33:52.857914 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9fbd6f-0e65-4711-b39a-412ca01cbd33 admin admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:33:52.857914 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9fbd6f-0e65-4711-b39a-412ca01cbd33 admin admin] PATH_INFO: `/v3/users` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:33:52.858545 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9fbd6f-0e65-4711-b39a-412ca01cbd33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:33:52.860486 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9fbd6f-0e65-4711-b39a-412ca01cbd33 admin admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:33:52.889540 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 578/1179] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Jul 25 21:33:52 2022] POST /identity/v3/users => generated 296 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 21:33:52.894070 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c11898-9565-4007-8da8-55cdd35b71eb admin admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:33:52.908550 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c11898-9565-4007-8da8-55cdd35b71eb admin admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:33:52.914318 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37dfa85-857b-4005-9b75-afa01ad8cd59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9501d798e8481da3be76351eec2bf6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:33:52.914958 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37dfa85-857b-4005-9b75-afa01ad8cd59 admin admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:33:52.915233 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37dfa85-857b-4005-9b75-afa01ad8cd59 admin admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:33:52.915499 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37dfa85-857b-4005-9b75-afa01ad8cd59 admin admin] PATH_INFO: `/v3/roles` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:33:52.916194 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37dfa85-857b-4005-9b75-afa01ad8cd59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:33:52.918375 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37dfa85-857b-4005-9b75-afa01ad8cd59 admin admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:33:52.931055 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 602/1180] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Jul 25 21:33:52 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 21:33:52.938864 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9fbd6f-0e65-4711-b39a-412ca01cbd33 admin admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:33:52.959342 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9fbd6f-0e65-4711-b39a-412ca01cbd33 admin admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:33:52.964751 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad8e88b-9a2a-4f63-82ac-eae377c06b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9501d798e8481da3be76351eec2bf6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:33:52.965687 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad8e88b-9a2a-4f63-82ac-eae377c06b86 admin admin] REQUEST_METHOD: `PUT` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:33:52.966286 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad8e88b-9a2a-4f63-82ac-eae377c06b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:33:52.966560 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad8e88b-9a2a-4f63-82ac-eae377c06b86 admin admin] PATH_INFO: `/v3/projects/89bc252d833141e499a64fc401927091/users/c7db724c32c04f2bb67e3cb409261769/roles/216a86497a3a4593ba08730ea8697df3` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:33:52.972495 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:33:52.989596 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad8e88b-9a2a-4f63-82ac-eae377c06b86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89bc252d833141e499a64fc401927091, user_id=c7db724c32c04f2bb67e3cb409261769, role_id=216a86497a3a4593ba08730ea8697df3)` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:33:52.992318 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad8e88b-9a2a-4f63-82ac-eae377c06b86 admin admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:33:53.024850 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 579/1181] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Jul 25 21:33:52 2022] PUT /identity/v3/projects/89bc252d833141e499a64fc401927091/users/c7db724c32c04f2bb67e3cb409261769/roles/216a86497a3a4593ba08730ea8697df3 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 21:33:53.028837 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37dfa85-857b-4005-9b75-afa01ad8cd59 admin admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:33:53.052789 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37dfa85-857b-4005-9b75-afa01ad8cd59 admin admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:33:53.128907 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa64ac79-5216-41db-bcf3-d3d5c078d059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9501d798e8481da3be76351eec2bf6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:33:53.129600 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa64ac79-5216-41db-bcf3-d3d5c078d059 admin admin] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:33:53.129877 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa64ac79-5216-41db-bcf3-d3d5c078d059 admin admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:33:53.130148 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa64ac79-5216-41db-bcf3-d3d5c078d059 admin admin] PATH_INFO: `/v3/roles` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:33:53.130842 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa64ac79-5216-41db-bcf3-d3d5c078d059 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:33:53.132812 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa64ac79-5216-41db-bcf3-d3d5c078d059 admin admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:33:53.151575 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad8e88b-9a2a-4f63-82ac-eae377c06b86 admin admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:33:53.161186 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 603/1182] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Jul 25 21:33:53 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 21:33:53.166541 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad8e88b-9a2a-4f63-82ac-eae377c06b86 admin admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:33:53.171540 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1376777f-7c20-4f5b-9142-ccb88ba88dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9501d798e8481da3be76351eec2bf6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:33:53.172244 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1376777f-7c20-4f5b-9142-ccb88ba88dd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:33:53.172522 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1376777f-7c20-4f5b-9142-ccb88ba88dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:33:53.172792 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1376777f-7c20-4f5b-9142-ccb88ba88dd0 admin admin] PATH_INFO: `/v3/projects/89bc252d833141e499a64fc401927091/users/c7db724c32c04f2bb67e3cb409261769/roles/216a86497a3a4593ba08730ea8697df3` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:33:53.175287 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1376777f-7c20-4f5b-9142-ccb88ba88dd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89bc252d833141e499a64fc401927091, user_id=c7db724c32c04f2bb67e3cb409261769, role_id=216a86497a3a4593ba08730ea8697df3)` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:33:53.178489 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1376777f-7c20-4f5b-9142-ccb88ba88dd0 admin admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:33:53.205815 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b796f1-4173-4ffe-8df0-80468393deb5 None None] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:33:53.206226 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b796f1-4173-4ffe-8df0-80468393deb5 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:33:53.207046 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b796f1-4173-4ffe-8df0-80468393deb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:33:53.210458 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 580/1183] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Jul 25 21:33:53 2022] PUT /identity/v3/projects/89bc252d833141e499a64fc401927091/users/c7db724c32c04f2bb67e3cb409261769/roles/216a86497a3a4593ba08730ea8697df3 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 21:33:53.257834 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.auth.core [None req-16b796f1-4173-4ffe-8df0-80468393deb5 None None] MFA Rules not processed for user `b0142184cb824ec9840066ed12f7f27b`. Rule list: `[]` (Enabled: `True`). {{(pid=87209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:33:53.259135 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-16b796f1-4173-4ffe-8df0-80468393deb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:33:53.358664 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 604/1184] 10.222.0.66 () {58 vars in 958 bytes} [Mon Jul 25 21:33:53 2022] POST /identity/v3/auth/tokens => generated 2812 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:33:53.363385 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1376777f-7c20-4f5b-9142-ccb88ba88dd0 admin admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:33:53.493120 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1376777f-7c20-4f5b-9142-ccb88ba88dd0 admin admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:33:53.506231 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca49685a-e910-4b07-ac2b-1226240ba5a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9501d798e8481da3be76351eec2bf6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:33:53.506231 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca49685a-e910-4b07-ac2b-1226240ba5a2 admin admin] REQUEST_METHOD: `POST` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:33:53.506231 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca49685a-e910-4b07-ac2b-1226240ba5a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:33:53.506231 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca49685a-e910-4b07-ac2b-1226240ba5a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:33:53.506761 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca49685a-e910-4b07-ac2b-1226240ba5a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:33:53.510706 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca49685a-e910-4b07-ac2b-1226240ba5a2 admin admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:33:53.554335 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 581/1185] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Jul 25 21:33:53 2022] POST /identity/v3/projects => generated 383 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 21:33:53.555967 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b796f1-4173-4ffe-8df0-80468393deb5 None None] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:33:53.568513 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b796f1-4173-4ffe-8df0-80468393deb5 None None] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:33:53.646993 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:33:53.659152 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798fba4a-6a56-4c3a-bdbc-37b3267f9c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9501d798e8481da3be76351eec2bf6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:33:53.661331 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798fba4a-6a56-4c3a-bdbc-37b3267f9c66 admin admin] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:33:53.661887 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798fba4a-6a56-4c3a-bdbc-37b3267f9c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:33:53.662933 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798fba4a-6a56-4c3a-bdbc-37b3267f9c66 admin admin] PATH_INFO: `/v3/users` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:33:53.663915 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798fba4a-6a56-4c3a-bdbc-37b3267f9c66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:33:53.666748 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798fba4a-6a56-4c3a-bdbc-37b3267f9c66 admin admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:33:53.695602 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 605/1186] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Jul 25 21:33:53 2022] POST /identity/v3/users => generated 298 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 21:33:53.699692 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca49685a-e910-4b07-ac2b-1226240ba5a2 admin admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:33:53.715565 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca49685a-e910-4b07-ac2b-1226240ba5a2 admin admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:33:53.719887 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b340bfae-f2ae-499c-86c4-c63a4f3586c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9501d798e8481da3be76351eec2bf6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:33:53.720524 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b340bfae-f2ae-499c-86c4-c63a4f3586c4 admin admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:33:53.720818 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b340bfae-f2ae-499c-86c4-c63a4f3586c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:33:53.721071 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b340bfae-f2ae-499c-86c4-c63a4f3586c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:33:53.722356 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b340bfae-f2ae-499c-86c4-c63a4f3586c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:33:53.725845 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b340bfae-f2ae-499c-86c4-c63a4f3586c4 admin admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:33:53.745246 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 582/1187] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Jul 25 21:33:53 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 21:33:53.746251 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798fba4a-6a56-4c3a-bdbc-37b3267f9c66 admin admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:33:53.766177 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798fba4a-6a56-4c3a-bdbc-37b3267f9c66 admin admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:33:53.771260 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7b7130-6e97-4d46-9e23-9c2fa72d76bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9501d798e8481da3be76351eec2bf6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:33:53.772269 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7b7130-6e97-4d46-9e23-9c2fa72d76bd admin admin] REQUEST_METHOD: `PUT` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:33:53.772647 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7b7130-6e97-4d46-9e23-9c2fa72d76bd admin admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:33:53.773006 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7b7130-6e97-4d46-9e23-9c2fa72d76bd admin admin] PATH_INFO: `/v3/projects/d2a57df529354a1882a39b6d4ceb223f/users/1d7c8fd93aa64400a7516c5513c6dedf/roles/216a86497a3a4593ba08730ea8697df3` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:33:53.799355 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7b7130-6e97-4d46-9e23-9c2fa72d76bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2a57df529354a1882a39b6d4ceb223f, user_id=1d7c8fd93aa64400a7516c5513c6dedf, role_id=216a86497a3a4593ba08730ea8697df3)` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:33:53.802503 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7b7130-6e97-4d46-9e23-9c2fa72d76bd admin admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:33:53.832504 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 606/1188] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Jul 25 21:33:53 2022] PUT /identity/v3/projects/d2a57df529354a1882a39b6d4ceb223f/users/1d7c8fd93aa64400a7516c5513c6dedf/roles/216a86497a3a4593ba08730ea8697df3 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 21:33:53.834287 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b340bfae-f2ae-499c-86c4-c63a4f3586c4 admin admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:33:53.847839 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b340bfae-f2ae-499c-86c4-c63a4f3586c4 admin admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:33:53.933873 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d579544c-0e04-418a-9110-79b7741cf641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9501d798e8481da3be76351eec2bf6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:33:53.934592 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d579544c-0e04-418a-9110-79b7741cf641 admin admin] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:33:53.934792 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d579544c-0e04-418a-9110-79b7741cf641 admin admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:33:53.935062 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d579544c-0e04-418a-9110-79b7741cf641 admin admin] PATH_INFO: `/v3/roles` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:33:53.935756 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d579544c-0e04-418a-9110-79b7741cf641 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:33:53.937470 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d579544c-0e04-418a-9110-79b7741cf641 admin admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:33:53.955064 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 583/1189] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Jul 25 21:33:53 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 21:33:53.958776 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7b7130-6e97-4d46-9e23-9c2fa72d76bd admin admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:33:53.974560 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7b7130-6e97-4d46-9e23-9c2fa72d76bd admin admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:33:53.990162 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414f8f39-9c9f-43f5-9773-5249d23191cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9501d798e8481da3be76351eec2bf6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:33:53.993288 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414f8f39-9c9f-43f5-9773-5249d23191cf admin admin] REQUEST_METHOD: `PUT` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:33:53.993838 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414f8f39-9c9f-43f5-9773-5249d23191cf admin admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:33:53.994349 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414f8f39-9c9f-43f5-9773-5249d23191cf admin admin] PATH_INFO: `/v3/projects/d2a57df529354a1882a39b6d4ceb223f/users/1d7c8fd93aa64400a7516c5513c6dedf/roles/216a86497a3a4593ba08730ea8697df3` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:33:53.997985 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414f8f39-9c9f-43f5-9773-5249d23191cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2a57df529354a1882a39b6d4ceb223f, user_id=1d7c8fd93aa64400a7516c5513c6dedf, role_id=216a86497a3a4593ba08730ea8697df3)` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:33:54.001624 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414f8f39-9c9f-43f5-9773-5249d23191cf admin admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:33:54.032826 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 607/1190] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Jul 25 21:33:53 2022] PUT /identity/v3/projects/d2a57df529354a1882a39b6d4ceb223f/users/1d7c8fd93aa64400a7516c5513c6dedf/roles/216a86497a3a4593ba08730ea8697df3 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 21:33:59.560777 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fb896c-b5dd-4e51-8165-a9fd5fe8cd0f None None] REQUEST_METHOD: `POST` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:33:59.561366 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fb896c-b5dd-4e51-8165-a9fd5fe8cd0f None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:33:59.561366 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fb896c-b5dd-4e51-8165-a9fd5fe8cd0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:33:59.625135 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.auth.core [None req-65fb896c-b5dd-4e51-8165-a9fd5fe8cd0f None None] MFA Rules not processed for user `c7db724c32c04f2bb67e3cb409261769`. Rule list: `[]` (Enabled: `True`). {{(pid=87210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:33:59.626494 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.fernet_utils [None req-65fb896c-b5dd-4e51-8165-a9fd5fe8cd0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:33:59.715393 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:33:59.812996 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 584/1191] 10.222.0.66 () {58 vars in 958 bytes} [Mon Jul 25 21:33:59 2022] POST /identity/v3/auth/tokens => generated 2873 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:33:59.829030 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414f8f39-9c9f-43f5-9773-5249d23191cf admin admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:33:59.832310 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-414f8f39-9c9f-43f5-9773-5249d23191cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:33:59.993827 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414f8f39-9c9f-43f5-9773-5249d23191cf admin admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:33:59.999951 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2c7ebb-914e-426e-9ecd-8de0557255df service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b47561e7cd048f79518db147de16c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e36d923af474a07adb12209580f12e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:34:00.001165 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2c7ebb-914e-426e-9ecd-8de0557255df service glance] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:34:00.001686 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2c7ebb-914e-426e-9ecd-8de0557255df service glance] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:34:00.002120 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2c7ebb-914e-426e-9ecd-8de0557255df service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:34:00.134884 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2c7ebb-914e-426e-9ecd-8de0557255df service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:34:00.137736 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2c7ebb-914e-426e-9ecd-8de0557255df service glance] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:34:00.170533 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 608/1192] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 25 21:33:59 2022] GET /identity/v3/auth/tokens => generated 2804 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:34:00.919637 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25a0442-a5a5-4fbe-a961-a62420053ee3 None None] REQUEST_METHOD: `POST` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:34:00.920221 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25a0442-a5a5-4fbe-a961-a62420053ee3 None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:34:00.920221 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25a0442-a5a5-4fbe-a961-a62420053ee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:34:00.994823 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.auth.core [None req-d25a0442-a5a5-4fbe-a961-a62420053ee3 None None] MFA Rules not processed for user `1d7c8fd93aa64400a7516c5513c6dedf`. Rule list: `[]` (Enabled: `True`). {{(pid=87210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:34:00.996175 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.fernet_utils [None req-d25a0442-a5a5-4fbe-a961-a62420053ee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:34:01.125662 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 585/1193] 10.222.0.66 () {58 vars in 958 bytes} [Mon Jul 25 21:34:00 2022] POST /identity/v3/auth/tokens => generated 2877 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:34:01.143024 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2c7ebb-914e-426e-9ecd-8de0557255df service glance] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:34:01.156587 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2c7ebb-914e-426e-9ecd-8de0557255df service glance] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:34:01.167326 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b53acf3-5e3a-46df-b6cf-b7c5b9007711 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b47561e7cd048f79518db147de16c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e36d923af474a07adb12209580f12e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:34:01.169560 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b53acf3-5e3a-46df-b6cf-b7c5b9007711 service glance] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:34:01.169560 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b53acf3-5e3a-46df-b6cf-b7c5b9007711 service glance] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:34:01.169560 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b53acf3-5e3a-46df-b6cf-b7c5b9007711 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:34:01.233012 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:34:01.251229 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b53acf3-5e3a-46df-b6cf-b7c5b9007711 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:34:01.252888 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b53acf3-5e3a-46df-b6cf-b7c5b9007711 service glance] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:34:01.263773 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 609/1194] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 25 21:34:01 2022] GET /identity/v3/auth/tokens => generated 2812 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:34:09.259731 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648502ad-9959-435a-9026-ae0d1be77ae0 None None] REQUEST_METHOD: `POST` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:34:09.260370 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648502ad-9959-435a-9026-ae0d1be77ae0 None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:34:09.260478 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648502ad-9959-435a-9026-ae0d1be77ae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:34:09.309411 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.auth.core [None req-648502ad-9959-435a-9026-ae0d1be77ae0 None None] MFA Rules not processed for user `b0142184cb824ec9840066ed12f7f27b`. Rule list: `[]` (Enabled: `True`). {{(pid=87210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:34:09.310625 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.fernet_utils [None req-648502ad-9959-435a-9026-ae0d1be77ae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:34:09.318161 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 586/1195] 10.222.0.66 () {58 vars in 958 bytes} [Mon Jul 25 21:34:09 2022] POST /identity/v3/auth/tokens => generated 2812 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:34:09.617535 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800f84de-2d58-4b0a-a411-1137bd40d8cc None None] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:34:09.618087 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800f84de-2d58-4b0a-a411-1137bd40d8cc None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:34:09.618087 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800f84de-2d58-4b0a-a411-1137bd40d8cc None None] PATH_INFO: `/` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:34:09.620053 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 610/1196] 10.222.0.66 () {54 vars in 962 bytes} [Mon Jul 25 21:34:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:34:09.626010 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e09dfb-b3fe-4a76-a11a-ba0f0a329781 None None] REQUEST_METHOD: `POST` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:34:09.626367 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e09dfb-b3fe-4a76-a11a-ba0f0a329781 None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:34:09.626634 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e09dfb-b3fe-4a76-a11a-ba0f0a329781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:34:09.658407 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.auth.core [None req-b7e09dfb-b3fe-4a76-a11a-ba0f0a329781 None None] MFA Rules not processed for user `524584f0d1b64e02a467b47de395c130`. Rule list: `[]` (Enabled: `True`). {{(pid=87210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:34:09.659625 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.fernet_utils [None req-b7e09dfb-b3fe-4a76-a11a-ba0f0a329781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:34:09.724662 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 587/1197] 10.222.0.66 () {58 vars in 1059 bytes} [Mon Jul 25 21:34:09 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 21:34:09.730742 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c10fa65-ea17-46f6-ac88-37ba5fd5e4f2 None None] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:34:09.731024 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c10fa65-ea17-46f6-ac88-37ba5fd5e4f2 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:34:09.731297 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c10fa65-ea17-46f6-ac88-37ba5fd5e4f2 None None] PATH_INFO: `/` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:34:09.732956 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 611/1198] 10.222.0.66 () {54 vars in 912 bytes} [Mon Jul 25 21:34:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:34:09.738170 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cc01d9-bec7-4d88-a1f1-748ca9cc10ae None None] REQUEST_METHOD: `POST` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:34:09.738632 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cc01d9-bec7-4d88-a1f1-748ca9cc10ae None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:34:09.738912 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cc01d9-bec7-4d88-a1f1-748ca9cc10ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:34:09.761219 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.auth.core [None req-85cc01d9-bec7-4d88-a1f1-748ca9cc10ae None None] MFA Rules not processed for user `524584f0d1b64e02a467b47de395c130`. Rule list: `[]` (Enabled: `True`). {{(pid=87210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:34:09.762446 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.fernet_utils [None req-85cc01d9-bec7-4d88-a1f1-748ca9cc10ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:34:09.771971 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 588/1199] 10.222.0.66 () {58 vars in 1009 bytes} [Mon Jul 25 21:34:09 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:34:09.784939 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c10fa65-ea17-46f6-ac88-37ba5fd5e4f2 None None] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:34:09.786959 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-3c10fa65-ea17-46f6-ac88-37ba5fd5e4f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:34:09.807547 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c10fa65-ea17-46f6-ac88-37ba5fd5e4f2 None None] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:34:09.811985 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70ae5e0-4517-422f-8b4b-dfdb20c210a3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b47561e7cd048f79518db147de16c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e36d923af474a07adb12209580f12e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:34:09.812626 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70ae5e0-4517-422f-8b4b-dfdb20c210a3 service glance] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:34:09.812901 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70ae5e0-4517-422f-8b4b-dfdb20c210a3 service glance] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:34:09.813201 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70ae5e0-4517-422f-8b4b-dfdb20c210a3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:34:09.825695 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70ae5e0-4517-422f-8b4b-dfdb20c210a3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:34:09.827160 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70ae5e0-4517-422f-8b4b-dfdb20c210a3 service glance] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:34:09.837673 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 612/1200] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 25 21:34:09 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:34:10.185155 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791bd2ae-ba9f-4dc2-a2e7-69c04d8ddd5b None None] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:34:10.186047 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791bd2ae-ba9f-4dc2-a2e7-69c04d8ddd5b None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:34:10.186423 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791bd2ae-ba9f-4dc2-a2e7-69c04d8ddd5b None None] PATH_INFO: `/` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:34:10.188142 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 589/1201] 10.222.0.66 () {54 vars in 912 bytes} [Mon Jul 25 21:34:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:34:10.193748 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9adecba-b38a-46f4-8cfc-c88037399cfa None None] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:34:10.194043 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9adecba-b38a-46f4-8cfc-c88037399cfa None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:34:10.194328 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9adecba-b38a-46f4-8cfc-c88037399cfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:34:10.231073 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.auth.core [None req-a9adecba-b38a-46f4-8cfc-c88037399cfa None None] MFA Rules not processed for user `704ea1ca162d4df3ab560d910d599851`. Rule list: `[]` (Enabled: `True`). {{(pid=87209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:34:10.232368 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-a9adecba-b38a-46f4-8cfc-c88037399cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:34:10.292715 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 613/1202] 10.222.0.66 () {58 vars in 1009 bytes} [Mon Jul 25 21:34:10 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:34:10.310803 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791bd2ae-ba9f-4dc2-a2e7-69c04d8ddd5b None None] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:34:10.312889 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.fernet_utils [None req-791bd2ae-ba9f-4dc2-a2e7-69c04d8ddd5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:34:10.326421 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791bd2ae-ba9f-4dc2-a2e7-69c04d8ddd5b None None] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:34:10.330045 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985d026c-c6c0-4c37-a52c-1420c34de59c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '704ea1ca162d4df3ab560d910d599851', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e36d923af474a07adb12209580f12e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:34:10.330845 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985d026c-c6c0-4c37-a52c-1420c34de59c service neutron] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:34:10.331156 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985d026c-c6c0-4c37-a52c-1420c34de59c service neutron] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:34:10.331429 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985d026c-c6c0-4c37-a52c-1420c34de59c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:34:10.339269 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985d026c-c6c0-4c37-a52c-1420c34de59c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:34:10.340704 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985d026c-c6c0-4c37-a52c-1420c34de59c service neutron] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:34:10.348959 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 590/1203] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 25 21:34:10 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:34:10.857911 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca3a51b-04df-40c3-8c4c-7a7336e00c8f None None] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:34:10.858356 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca3a51b-04df-40c3-8c4c-7a7336e00c8f None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:34:10.858585 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca3a51b-04df-40c3-8c4c-7a7336e00c8f None None] PATH_INFO: `/` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:34:10.860779 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 614/1204] 10.222.0.66 () {54 vars in 962 bytes} [Mon Jul 25 21:34:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:34:10.866298 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c2d234-44d1-4fad-9c79-c9de422667de None None] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:34:10.866783 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c2d234-44d1-4fad-9c79-c9de422667de None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:34:10.868587 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fcdc71-2ca2-4bbe-96a6-933b4251f559 None None] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:34:10.868862 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fcdc71-2ca2-4bbe-96a6-933b4251f559 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:34:10.869570 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fcdc71-2ca2-4bbe-96a6-933b4251f559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:34:10.872662 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c2d234-44d1-4fad-9c79-c9de422667de None None] PATH_INFO: `/` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:34:10.874586 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 591/1205] 10.222.0.66 () {54 vars in 961 bytes} [Mon Jul 25 21:34:10 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:34:10.880196 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840d0b8e-9fc7-4b33-965d-b7e9966f949a None None] REQUEST_METHOD: `POST` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:34:10.880482 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840d0b8e-9fc7-4b33-965d-b7e9966f949a None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:34:10.880770 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840d0b8e-9fc7-4b33-965d-b7e9966f949a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:34:10.896591 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.auth.core [None req-d1fcdc71-2ca2-4bbe-96a6-933b4251f559 None None] MFA Rules not processed for user `524584f0d1b64e02a467b47de395c130`. Rule list: `[]` (Enabled: `True`). {{(pid=87209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:34:10.898594 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-d1fcdc71-2ca2-4bbe-96a6-933b4251f559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:34:10.906196 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.auth.core [None req-840d0b8e-9fc7-4b33-965d-b7e9966f949a None None] MFA Rules not processed for user `3e0e5ab2acc3425c9d820f2027f5652b`. Rule list: `[]` (Enabled: `True`). {{(pid=87210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:34:10.907557 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.fernet_utils [None req-840d0b8e-9fc7-4b33-965d-b7e9966f949a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:34:10.910132 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 615/1206] 10.222.0.66 () {58 vars in 1059 bytes} [Mon Jul 25 21:34:10 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:34:10.914795 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=100 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:34:10.917690 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3f51cd-00e4-43c1-bb63-b3954aca5fdd None None] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:34:10.918155 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3f51cd-00e4-43c1-bb63-b3954aca5fdd None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:34:10.918717 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3f51cd-00e4-43c1-bb63-b3954aca5fdd None None] PATH_INFO: `/` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:34:10.926179 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 616/1207] 10.222.0.66 () {54 vars in 912 bytes} [Mon Jul 25 21:34:10 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:34:10.932569 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f9172b-d4d7-4de8-9409-e37abb576802 None None] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:34:10.933716 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f9172b-d4d7-4de8-9409-e37abb576802 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:34:10.934886 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f9172b-d4d7-4de8-9409-e37abb576802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:34:10.978477 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.auth.core [None req-16f9172b-d4d7-4de8-9409-e37abb576802 None None] MFA Rules not processed for user `524584f0d1b64e02a467b47de395c130`. Rule list: `[]` (Enabled: `True`). {{(pid=87209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:34:10.981273 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-16f9172b-d4d7-4de8-9409-e37abb576802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:34:10.994131 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 592/1208] 10.222.0.66 () {58 vars in 1058 bytes} [Mon Jul 25 21:34:10 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 21:34:10.995004 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 617/1209] 10.222.0.66 () {58 vars in 1009 bytes} [Mon Jul 25 21:34:10 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:34:10.995883 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840d0b8e-9fc7-4b33-965d-b7e9966f949a None None] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:34:11.007247 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840d0b8e-9fc7-4b33-965d-b7e9966f949a None None] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:34:11.007435 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f9172b-d4d7-4de8-9409-e37abb576802 None None] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:34:11.013343 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa94eda-bff3-4716-8926-8a54c32325a1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e0e5ab2acc3425c9d820f2027f5652b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e36d923af474a07adb12209580f12e1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:34:11.014769 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa94eda-bff3-4716-8926-8a54c32325a1 service placement] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:34:11.015151 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa94eda-bff3-4716-8926-8a54c32325a1 service placement] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:34:11.015516 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa94eda-bff3-4716-8926-8a54c32325a1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:34:11.018486 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.fernet_utils [None req-1fa94eda-bff3-4716-8926-8a54c32325a1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:34:11.026010 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f9172b-d4d7-4de8-9409-e37abb576802 None None] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:34:11.035881 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa94eda-bff3-4716-8926-8a54c32325a1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:34:11.038260 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa94eda-bff3-4716-8926-8a54c32325a1 service placement] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:34:11.038598 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ed2498-e8e0-4fe2-b942-fa18badbe079 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '704ea1ca162d4df3ab560d910d599851', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e36d923af474a07adb12209580f12e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:34:11.039407 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ed2498-e8e0-4fe2-b942-fa18badbe079 service neutron] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:34:11.042410 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ed2498-e8e0-4fe2-b942-fa18badbe079 service neutron] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:34:11.042719 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ed2498-e8e0-4fe2-b942-fa18badbe079 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:34:11.053281 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 593/1210] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 25 21:34:10 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:34:11.066250 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ed2498-e8e0-4fe2-b942-fa18badbe079 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:34:11.069361 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ed2498-e8e0-4fe2-b942-fa18badbe079 service neutron] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:34:11.091063 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 618/1211] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 25 21:34:11 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:34:21.009980 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef617ce-8b00-4569-98a8-9fc97faa54d5 None None] REQUEST_METHOD: `POST` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:34:21.010577 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef617ce-8b00-4569-98a8-9fc97faa54d5 None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:34:21.010577 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef617ce-8b00-4569-98a8-9fc97faa54d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:34:21.034230 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.auth.core [None req-cef617ce-8b00-4569-98a8-9fc97faa54d5 None None] MFA Rules not processed for user `704ea1ca162d4df3ab560d910d599851`. Rule list: `[]` (Enabled: `True`). {{(pid=87210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:34:21.035587 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.fernet_utils [None req-cef617ce-8b00-4569-98a8-9fc97faa54d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:34:21.042912 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 594/1212] 10.222.0.81 () {58 vars in 1015 bytes} [Mon Jul 25 21:34:21 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:34:21.055089 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ed2498-e8e0-4fe2-b942-fa18badbe079 service neutron] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:34:21.064807 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ed2498-e8e0-4fe2-b942-fa18badbe079 service neutron] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:34:21.068473 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbb981e-cadf-4634-9c88-9ba53c33021f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '704ea1ca162d4df3ab560d910d599851', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e36d923af474a07adb12209580f12e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:34:21.069139 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbb981e-cadf-4634-9c88-9ba53c33021f service neutron] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:34:21.069412 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbb981e-cadf-4634-9c88-9ba53c33021f service neutron] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:34:21.069682 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbb981e-cadf-4634-9c88-9ba53c33021f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:34:21.080207 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbb981e-cadf-4634-9c88-9ba53c33021f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:34:21.081665 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbb981e-cadf-4634-9c88-9ba53c33021f service neutron] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:34:21.090774 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 619/1213] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 25 21:34:21 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:34:22.049444 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d37576-bb5e-4ff9-8a7d-555900755f6f None None] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:34:22.050002 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d37576-bb5e-4ff9-8a7d-555900755f6f None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:34:22.050142 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d37576-bb5e-4ff9-8a7d-555900755f6f None None] PATH_INFO: `/` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:34:22.052027 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 595/1214] 10.222.0.66 () {54 vars in 921 bytes} [Mon Jul 25 21:34:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:34:22.084282 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9469dc99-6e9d-42e2-81bd-f5abd4596734 None None] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:34:22.084856 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9469dc99-6e9d-42e2-81bd-f5abd4596734 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:34:22.084856 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9469dc99-6e9d-42e2-81bd-f5abd4596734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:34:22.109930 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.auth.core [None req-9469dc99-6e9d-42e2-81bd-f5abd4596734 None None] MFA Rules not processed for user `524584f0d1b64e02a467b47de395c130`. Rule list: `[]` (Enabled: `True`). {{(pid=87209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:34:22.111171 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-9469dc99-6e9d-42e2-81bd-f5abd4596734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:34:22.125240 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 620/1215] 10.222.0.66 () {58 vars in 1018 bytes} [Mon Jul 25 21:34:22 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:34:22.147989 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d37576-bb5e-4ff9-8a7d-555900755f6f None None] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:34:22.184094 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d37576-bb5e-4ff9-8a7d-555900755f6f None None] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:34:22.196676 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3ef5cd-5cac-4362-8eb9-d2b559cf98e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '524584f0d1b64e02a467b47de395c130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e36d923af474a07adb12209580f12e1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:34:22.197418 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3ef5cd-5cac-4362-8eb9-d2b559cf98e5 service nova] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:34:22.197694 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3ef5cd-5cac-4362-8eb9-d2b559cf98e5 service nova] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:34:22.197962 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3ef5cd-5cac-4362-8eb9-d2b559cf98e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:34:22.212386 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3ef5cd-5cac-4362-8eb9-d2b559cf98e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:34:22.214212 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3ef5cd-5cac-4362-8eb9-d2b559cf98e5 service nova] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:34:22.231341 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 596/1216] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 25 21:34:22 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:34:28.538690 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7536822a-634a-49a6-bc1c-b40894933217 None None] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:34:28.539232 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7536822a-634a-49a6-bc1c-b40894933217 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:34:28.539232 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7536822a-634a-49a6-bc1c-b40894933217 None None] PATH_INFO: `/` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:34:28.541146 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 621/1217] 10.222.0.66 () {54 vars in 921 bytes} [Mon Jul 25 21:34:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:34:28.551443 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c53440-5cdd-49f6-88e0-c6f75e3c08ff None None] REQUEST_METHOD: `POST` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:34:28.551986 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c53440-5cdd-49f6-88e0-c6f75e3c08ff None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:34:28.551986 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c53440-5cdd-49f6-88e0-c6f75e3c08ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:34:28.577841 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.auth.core [None req-36c53440-5cdd-49f6-88e0-c6f75e3c08ff None None] MFA Rules not processed for user `524584f0d1b64e02a467b47de395c130`. Rule list: `[]` (Enabled: `True`). {{(pid=87210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:34:28.579333 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.fernet_utils [None req-36c53440-5cdd-49f6-88e0-c6f75e3c08ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:34:28.589431 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 597/1218] 10.222.0.66 () {58 vars in 1018 bytes} [Mon Jul 25 21:34:28 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:34:28.603625 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7536822a-634a-49a6-bc1c-b40894933217 None None] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:34:28.620032 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7536822a-634a-49a6-bc1c-b40894933217 None None] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:34:28.625833 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fda1e11-d7dc-4daf-b128-348d43b6200c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '524584f0d1b64e02a467b47de395c130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e36d923af474a07adb12209580f12e1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:34:28.626788 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fda1e11-d7dc-4daf-b128-348d43b6200c service nova] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:34:28.626788 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fda1e11-d7dc-4daf-b128-348d43b6200c service nova] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:34:28.627106 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fda1e11-d7dc-4daf-b128-348d43b6200c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:34:28.637625 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fda1e11-d7dc-4daf-b128-348d43b6200c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:34:28.639258 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fda1e11-d7dc-4daf-b128-348d43b6200c service nova] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:34:28.649843 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 622/1219] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 25 21:34:28 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:34:38.570976 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=42 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:34:38.645433 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=67 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:34:39.696772 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c53440-5cdd-49f6-88e0-c6f75e3c08ff None None] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:34:39.707489 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c53440-5cdd-49f6-88e0-c6f75e3c08ff None None] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:34:39.711411 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ecda40-03c3-4419-b796-25ba7a8503ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '704ea1ca162d4df3ab560d910d599851', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e36d923af474a07adb12209580f12e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:34:39.712240 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ecda40-03c3-4419-b796-25ba7a8503ab service neutron] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:34:39.712500 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ecda40-03c3-4419-b796-25ba7a8503ab service neutron] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:34:39.712768 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ecda40-03c3-4419-b796-25ba7a8503ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:34:39.722181 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ecda40-03c3-4419-b796-25ba7a8503ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:34:39.723620 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ecda40-03c3-4419-b796-25ba7a8503ab service neutron] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:34:39.733346 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 598/1220] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 25 21:34:39 2022] GET /identity/v3/auth/tokens => generated 2877 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:34:41.910679 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94578b7-c449-46e9-a394-c5e7b172526c None None] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:34:41.911380 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94578b7-c449-46e9-a394-c5e7b172526c None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:34:41.911380 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94578b7-c449-46e9-a394-c5e7b172526c None None] PATH_INFO: `/` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:34:41.912616 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 623/1221] 10.222.0.66 () {54 vars in 921 bytes} [Mon Jul 25 21:34:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:34:41.917923 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39d4fa6-ea7d-42e3-a52a-3da991bc9a3c None None] REQUEST_METHOD: `POST` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:34:41.919240 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39d4fa6-ea7d-42e3-a52a-3da991bc9a3c None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:34:41.919655 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39d4fa6-ea7d-42e3-a52a-3da991bc9a3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:34:41.955578 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.auth.core [None req-a39d4fa6-ea7d-42e3-a52a-3da991bc9a3c None None] MFA Rules not processed for user `524584f0d1b64e02a467b47de395c130`. Rule list: `[]` (Enabled: `True`). {{(pid=87210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:34:41.957464 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.fernet_utils [None req-a39d4fa6-ea7d-42e3-a52a-3da991bc9a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:34:41.968309 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 599/1222] 10.222.0.66 () {58 vars in 1018 bytes} [Mon Jul 25 21:34:41 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:34:41.991270 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94578b7-c449-46e9-a394-c5e7b172526c None None] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:34:42.009637 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94578b7-c449-46e9-a394-c5e7b172526c None None] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:34:42.015702 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe938426-a7fc-4906-8746-54091951a4d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '524584f0d1b64e02a467b47de395c130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e36d923af474a07adb12209580f12e1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:34:42.016607 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe938426-a7fc-4906-8746-54091951a4d4 service nova] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:34:42.017276 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe938426-a7fc-4906-8746-54091951a4d4 service nova] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:34:42.017717 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe938426-a7fc-4906-8746-54091951a4d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:34:42.028027 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe938426-a7fc-4906-8746-54091951a4d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:34:42.030220 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe938426-a7fc-4906-8746-54091951a4d4 service nova] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:34:42.041951 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 624/1223] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 25 21:34:41 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:34:51.945144 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=9 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:34:52.037343 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=6 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:35:01.705400 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b9ca65-65b4-4ae8-a24d-e8fe79aca5f8 None None] REQUEST_METHOD: `POST` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:35:01.705971 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b9ca65-65b4-4ae8-a24d-e8fe79aca5f8 None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:35:01.705971 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b9ca65-65b4-4ae8-a24d-e8fe79aca5f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:35:01.726100 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.auth.core [None req-56b9ca65-65b4-4ae8-a24d-e8fe79aca5f8 None None] MFA Rules not processed for user `b248db46f9ef442ebf585f91397e71c3`. Rule list: `[]` (Enabled: `True`). {{(pid=87210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:35:01.727307 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.fernet_utils [None req-56b9ca65-65b4-4ae8-a24d-e8fe79aca5f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:35:01.735455 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 600/1224] 10.222.0.66 () {58 vars in 958 bytes} [Mon Jul 25 21:35:01 2022] POST /identity/v3/auth/tokens => generated 2804 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:35:11.720628 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=3 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:35:26.364453 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b4e069-12d8-4cf1-9b58-46b10d8f4653 None None] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:35:26.365074 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b4e069-12d8-4cf1-9b58-46b10d8f4653 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:35:26.365454 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b4e069-12d8-4cf1-9b58-46b10d8f4653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:35:26.395239 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.auth.core [None req-89b4e069-12d8-4cf1-9b58-46b10d8f4653 None None] MFA Rules not processed for user `b248db46f9ef442ebf585f91397e71c3`. Rule list: `[]` (Enabled: `True`). {{(pid=87209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:35:26.396437 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-89b4e069-12d8-4cf1-9b58-46b10d8f4653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:35:26.404603 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 625/1225] 10.222.0.66 () {58 vars in 958 bytes} [Mon Jul 25 21:35:26 2022] POST /identity/v3/auth/tokens => generated 2804 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:35:36.388070 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=3 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:35:41.294003 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf70bf-b7f1-41c1-a8f7-2b80bd678277 None None] REQUEST_METHOD: `POST` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:35:41.294530 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf70bf-b7f1-41c1-a8f7-2b80bd678277 None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:35:41.294530 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf70bf-b7f1-41c1-a8f7-2b80bd678277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:35:41.314791 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.auth.core [None req-3ecf70bf-b7f1-41c1-a8f7-2b80bd678277 None None] MFA Rules not processed for user `b248db46f9ef442ebf585f91397e71c3`. Rule list: `[]` (Enabled: `True`). {{(pid=87210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:35:41.316108 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.fernet_utils [None req-3ecf70bf-b7f1-41c1-a8f7-2b80bd678277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:35:41.324547 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 601/1226] 10.222.0.66 () {58 vars in 958 bytes} [Mon Jul 25 21:35:41 2022] POST /identity/v3/auth/tokens => generated 2804 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:35:51.309572 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=3 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:36:40.602884 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb986ca7-629d-4dba-ac79-59d6661839ad None None] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:36:40.603374 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb986ca7-629d-4dba-ac79-59d6661839ad None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:36:40.603474 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb986ca7-629d-4dba-ac79-59d6661839ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:36:40.623933 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.auth.core [None req-cb986ca7-629d-4dba-ac79-59d6661839ad None None] MFA Rules not processed for user `b248db46f9ef442ebf585f91397e71c3`. Rule list: `[]` (Enabled: `True`). {{(pid=87209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:36:40.625202 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-cb986ca7-629d-4dba-ac79-59d6661839ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:36:40.633939 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 626/1227] 10.222.0.66 () {58 vars in 958 bytes} [Mon Jul 25 21:36:40 2022] POST /identity/v3/auth/tokens => generated 2804 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:36:41.002469 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224e6fd5-0e1d-4c3f-8f51-d913af0b4ddd None None] REQUEST_METHOD: `POST` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:36:41.003011 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224e6fd5-0e1d-4c3f-8f51-d913af0b4ddd None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:36:41.003238 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224e6fd5-0e1d-4c3f-8f51-d913af0b4ddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:36:41.052409 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.auth.core [None req-224e6fd5-0e1d-4c3f-8f51-d913af0b4ddd None None] MFA Rules not processed for user `704ea1ca162d4df3ab560d910d599851`. Rule list: `[]` (Enabled: `True`). {{(pid=87210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:36:41.053872 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.fernet_utils [None req-224e6fd5-0e1d-4c3f-8f51-d913af0b4ddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:36:41.070123 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 602/1228] 10.222.0.66 () {58 vars in 1009 bytes} [Mon Jul 25 21:36:41 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:36:41.081631 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb986ca7-629d-4dba-ac79-59d6661839ad None None] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:36:41.091520 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb986ca7-629d-4dba-ac79-59d6661839ad None None] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:36:41.095392 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f7bc70-0cda-4732-8788-66689800bbe3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '704ea1ca162d4df3ab560d910d599851', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e36d923af474a07adb12209580f12e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:36:41.096013 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f7bc70-0cda-4732-8788-66689800bbe3 service neutron] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:36:41.096295 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f7bc70-0cda-4732-8788-66689800bbe3 service neutron] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:36:41.096570 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f7bc70-0cda-4732-8788-66689800bbe3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:36:41.103467 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f7bc70-0cda-4732-8788-66689800bbe3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:36:41.104954 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f7bc70-0cda-4732-8788-66689800bbe3 service neutron] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:36:41.112749 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 627/1229] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 25 21:36:41 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:36:51.067321 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=17 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:36:51.110556 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=9 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:36:54.058210 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224e6fd5-0e1d-4c3f-8f51-d913af0b4ddd None None] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:36:54.067242 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224e6fd5-0e1d-4c3f-8f51-d913af0b4ddd None None] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:36:54.070957 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9e902d-c485-4645-96ff-a55b7d12e3be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '704ea1ca162d4df3ab560d910d599851', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e36d923af474a07adb12209580f12e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:36:54.071577 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9e902d-c485-4645-96ff-a55b7d12e3be service neutron] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:36:54.071858 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9e902d-c485-4645-96ff-a55b7d12e3be service neutron] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:36:54.072130 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9e902d-c485-4645-96ff-a55b7d12e3be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:36:54.081872 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9e902d-c485-4645-96ff-a55b7d12e3be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:36:54.083322 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9e902d-c485-4645-96ff-a55b7d12e3be service neutron] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:36:54.092878 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 603/1230] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 25 21:36:54 2022] GET /identity/v3/auth/tokens => generated 2873 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:37:04.088799 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=6 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:38:09.615282 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f7bc70-0cda-4732-8788-66689800bbe3 service neutron] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:38:09.641431 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f7bc70-0cda-4732-8788-66689800bbe3 service neutron] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:38:09.647903 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791970bf-e1c8-47d8-bca6-482576464352 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e0e5ab2acc3425c9d820f2027f5652b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e36d923af474a07adb12209580f12e1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:38:09.648526 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791970bf-e1c8-47d8-bca6-482576464352 service placement] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:38:09.648808 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791970bf-e1c8-47d8-bca6-482576464352 service placement] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:38:09.649115 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791970bf-e1c8-47d8-bca6-482576464352 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:38:09.658278 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791970bf-e1c8-47d8-bca6-482576464352 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:38:09.659945 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791970bf-e1c8-47d8-bca6-482576464352 service placement] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:38:09.671131 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 628/1231] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 25 21:38:09 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:38:19.666176 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=10 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:38:30.518540 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931f675a-c946-4f6a-8936-c1dc47898307 None None] REQUEST_METHOD: `POST` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:38:30.519144 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931f675a-c946-4f6a-8936-c1dc47898307 None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:38:30.519144 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931f675a-c946-4f6a-8936-c1dc47898307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:38:30.540480 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.auth.core [None req-931f675a-c946-4f6a-8936-c1dc47898307 None None] MFA Rules not processed for user `b0142184cb824ec9840066ed12f7f27b`. Rule list: `[]` (Enabled: `True`). {{(pid=87210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:38:30.541758 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.fernet_utils [None req-931f675a-c946-4f6a-8936-c1dc47898307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:38:30.549921 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 604/1232] 10.222.0.66 () {58 vars in 958 bytes} [Mon Jul 25 21:38:30 2022] POST /identity/v3/auth/tokens => generated 2812 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:38:40.535353 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=3 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:39:01.630588 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791970bf-e1c8-47d8-bca6-482576464352 service placement] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:39:01.655659 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791970bf-e1c8-47d8-bca6-482576464352 service placement] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:39:01.662297 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06792e35-c8cc-4906-9139-98a60394f2e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '524584f0d1b64e02a467b47de395c130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e36d923af474a07adb12209580f12e1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:39:01.662913 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06792e35-c8cc-4906-9139-98a60394f2e0 service nova] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:39:01.663197 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06792e35-c8cc-4906-9139-98a60394f2e0 service nova] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:39:01.663462 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06792e35-c8cc-4906-9139-98a60394f2e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:39:01.672204 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06792e35-c8cc-4906-9139-98a60394f2e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:39:01.673849 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06792e35-c8cc-4906-9139-98a60394f2e0 service nova] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:39:01.683353 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 629/1233] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 25 21:39:01 2022] GET /identity/v3/auth/tokens => generated 2804 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:39:05.361569 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13de2f8d-dbe1-4ca3-acff-d97494ea2d3c None None] REQUEST_METHOD: `POST` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:39:05.362069 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13de2f8d-dbe1-4ca3-acff-d97494ea2d3c None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:39:05.362156 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13de2f8d-dbe1-4ca3-acff-d97494ea2d3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:39:05.382180 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.auth.core [None req-13de2f8d-dbe1-4ca3-acff-d97494ea2d3c None None] MFA Rules not processed for user `b248db46f9ef442ebf585f91397e71c3`. Rule list: `[]` (Enabled: `True`). {{(pid=87210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:39:05.383408 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.fernet_utils [None req-13de2f8d-dbe1-4ca3-acff-d97494ea2d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:39:05.391618 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 605/1234] 10.222.0.66 () {58 vars in 958 bytes} [Mon Jul 25 21:39:05 2022] POST /identity/v3/auth/tokens => generated 2804 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:39:09.737607 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06792e35-c8cc-4906-9139-98a60394f2e0 service nova] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:39:09.751145 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06792e35-c8cc-4906-9139-98a60394f2e0 service nova] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:39:09.755640 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8565a6-97a7-4227-8211-669d0e014fa0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '704ea1ca162d4df3ab560d910d599851', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e36d923af474a07adb12209580f12e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:39:09.756326 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8565a6-97a7-4227-8211-669d0e014fa0 service neutron] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:39:09.756543 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8565a6-97a7-4227-8211-669d0e014fa0 service neutron] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:39:09.756811 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8565a6-97a7-4227-8211-669d0e014fa0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:39:09.768316 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8565a6-97a7-4227-8211-669d0e014fa0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:39:09.770827 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8565a6-97a7-4227-8211-669d0e014fa0 service neutron] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:39:09.783672 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 630/1235] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 25 21:39:09 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:39:11.054844 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13de2f8d-dbe1-4ca3-acff-d97494ea2d3c None None] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:39:11.065661 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13de2f8d-dbe1-4ca3-acff-d97494ea2d3c None None] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:39:11.070312 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc74b40-172d-41e3-b67c-c92edae829a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '704ea1ca162d4df3ab560d910d599851', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e36d923af474a07adb12209580f12e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:39:11.070933 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc74b40-172d-41e3-b67c-c92edae829a5 service neutron] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:39:11.071204 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc74b40-172d-41e3-b67c-c92edae829a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:39:11.071469 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc74b40-172d-41e3-b67c-c92edae829a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:39:11.081677 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc74b40-172d-41e3-b67c-c92edae829a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:39:11.083102 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc74b40-172d-41e3-b67c-c92edae829a5 service neutron] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:39:11.093025 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 606/1236] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 25 21:39:11 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:39:19.778773 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=16 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:39:20.579146 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8565a6-97a7-4227-8211-669d0e014fa0 service neutron] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:39:20.588867 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8565a6-97a7-4227-8211-669d0e014fa0 service neutron] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:39:20.593670 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b826b8f0-bdc9-4720-946d-6a1aec79acd4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '704ea1ca162d4df3ab560d910d599851', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e36d923af474a07adb12209580f12e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:39:20.595252 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b826b8f0-bdc9-4720-946d-6a1aec79acd4 service neutron] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:39:20.595533 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b826b8f0-bdc9-4720-946d-6a1aec79acd4 service neutron] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:39:20.595800 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b826b8f0-bdc9-4720-946d-6a1aec79acd4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:39:20.604097 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b826b8f0-bdc9-4720-946d-6a1aec79acd4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:39:20.605602 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b826b8f0-bdc9-4720-946d-6a1aec79acd4 service neutron] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:39:20.614955 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 631/1237] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 25 21:39:20 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 21:39:21.088732 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=9 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:39:22.669649 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc74b40-172d-41e3-b67c-c92edae829a5 service neutron] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:39:22.681342 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc74b40-172d-41e3-b67c-c92edae829a5 service neutron] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:39:22.688640 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3ed6da-6410-41e6-b9ba-a0fc5a8cb353 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '524584f0d1b64e02a467b47de395c130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e36d923af474a07adb12209580f12e1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:39:22.689306 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3ed6da-6410-41e6-b9ba-a0fc5a8cb353 service nova] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:39:22.689578 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3ed6da-6410-41e6-b9ba-a0fc5a8cb353 service nova] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:39:22.689846 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3ed6da-6410-41e6-b9ba-a0fc5a8cb353 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:39:22.698443 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3ed6da-6410-41e6-b9ba-a0fc5a8cb353 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:39:22.700235 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3ed6da-6410-41e6-b9ba-a0fc5a8cb353 service nova] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:39:22.710159 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 607/1238] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 25 21:39:22 2022] GET /identity/v3/auth/tokens => generated 2812 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:39:30.611055 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=6 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:39:32.705610 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=6 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:40:13.730192 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b826b8f0-bdc9-4720-946d-6a1aec79acd4 service neutron] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:40:13.753974 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b826b8f0-bdc9-4720-946d-6a1aec79acd4 service neutron] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:40:13.761355 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277a5fe3-53d5-4a58-b166-f05d7b6e0c76 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '524584f0d1b64e02a467b47de395c130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e36d923af474a07adb12209580f12e1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:40:13.762407 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277a5fe3-53d5-4a58-b166-f05d7b6e0c76 service nova] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:40:13.762975 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277a5fe3-53d5-4a58-b166-f05d7b6e0c76 service nova] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:40:13.763371 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277a5fe3-53d5-4a58-b166-f05d7b6e0c76 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:40:13.775152 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277a5fe3-53d5-4a58-b166-f05d7b6e0c76 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:40:13.777141 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277a5fe3-53d5-4a58-b166-f05d7b6e0c76 service nova] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:40:13.791506 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 632/1239] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 25 21:40:13 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:40:21.995098 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3ed6da-6410-41e6-b9ba-a0fc5a8cb353 service nova] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:40:22.006598 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3ed6da-6410-41e6-b9ba-a0fc5a8cb353 service nova] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:40:22.010846 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01b793d-a980-4b55-bf92-047f0cfc4b12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '704ea1ca162d4df3ab560d910d599851', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e36d923af474a07adb12209580f12e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:40:22.011736 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01b793d-a980-4b55-bf92-047f0cfc4b12 service neutron] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:40:22.012135 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01b793d-a980-4b55-bf92-047f0cfc4b12 service neutron] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:40:22.012633 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01b793d-a980-4b55-bf92-047f0cfc4b12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:40:22.082182 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01b793d-a980-4b55-bf92-047f0cfc4b12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:40:22.083856 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01b793d-a980-4b55-bf92-047f0cfc4b12 service neutron] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:40:22.104939 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 608/1240] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 25 21:40:21 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:40:23.785774 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=6 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:40:25.641442 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12fbd60-7539-451e-879b-94f5859c1a42 None None] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:40:25.642382 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12fbd60-7539-451e-879b-94f5859c1a42 None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:40:25.642778 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12fbd60-7539-451e-879b-94f5859c1a42 None None] PATH_INFO: `/` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:40:25.644415 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 633/1241] 10.222.0.66 () {54 vars in 921 bytes} [Mon Jul 25 21:40:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:40:25.655647 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7eb706-93e2-4d42-9684-c7ed324a17b6 None None] REQUEST_METHOD: `POST` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:40:25.656120 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7eb706-93e2-4d42-9684-c7ed324a17b6 None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:40:25.656330 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7eb706-93e2-4d42-9684-c7ed324a17b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:40:25.719366 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.auth.core [None req-7c7eb706-93e2-4d42-9684-c7ed324a17b6 None None] MFA Rules not processed for user `3e0e5ab2acc3425c9d820f2027f5652b`. Rule list: `[]` (Enabled: `True`). {{(pid=87210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:40:25.719366 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.fernet_utils [None req-7c7eb706-93e2-4d42-9684-c7ed324a17b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:40:25.726040 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 609/1242] 10.222.0.66 () {58 vars in 1018 bytes} [Mon Jul 25 21:40:25 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 21:40:25.743966 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12fbd60-7539-451e-879b-94f5859c1a42 None None] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:40:25.758198 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12fbd60-7539-451e-879b-94f5859c1a42 None None] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:40:25.765569 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fd560c-ba92-4304-8f6e-121f0fc09d4d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e0e5ab2acc3425c9d820f2027f5652b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e36d923af474a07adb12209580f12e1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:40:25.766131 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fd560c-ba92-4304-8f6e-121f0fc09d4d service placement] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:40:25.766410 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fd560c-ba92-4304-8f6e-121f0fc09d4d service placement] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:40:25.766682 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fd560c-ba92-4304-8f6e-121f0fc09d4d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:40:25.776110 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fd560c-ba92-4304-8f6e-121f0fc09d4d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:40:25.777793 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fd560c-ba92-4304-8f6e-121f0fc09d4d service placement] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:40:25.787673 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 634/1243] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 25 21:40:25 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:40:29.285705 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5ee7a8-ce98-4f80-bf88-60927d56a214 None None] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:40:29.286239 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5ee7a8-ce98-4f80-bf88-60927d56a214 None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:40:29.286239 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5ee7a8-ce98-4f80-bf88-60927d56a214 None None] PATH_INFO: `/` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:40:29.287698 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 610/1244] 10.222.0.66 () {54 vars in 921 bytes} [Mon Jul 25 21:40:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:40:29.318550 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a078610-738f-4e71-bd8f-73474decbb7c None None] REQUEST_METHOD: `POST` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:40:29.319065 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a078610-738f-4e71-bd8f-73474decbb7c None None] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:40:29.319184 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a078610-738f-4e71-bd8f-73474decbb7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:40:29.340757 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.auth.core [None req-5a078610-738f-4e71-bd8f-73474decbb7c None None] MFA Rules not processed for user `3e0e5ab2acc3425c9d820f2027f5652b`. Rule list: `[]` (Enabled: `True`). {{(pid=87209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:40:29.342098 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-5a078610-738f-4e71-bd8f-73474decbb7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:40:29.353400 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 635/1245] 10.222.0.66 () {58 vars in 1018 bytes} [Mon Jul 25 21:40:29 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:40:29.368551 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5ee7a8-ce98-4f80-bf88-60927d56a214 None None] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:40:29.373787 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a078610-738f-4e71-bd8f-73474decbb7c None None] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:40:29.384732 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a078610-738f-4e71-bd8f-73474decbb7c None None] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:40:29.384874 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5ee7a8-ce98-4f80-bf88-60927d56a214 None None] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:40:29.389937 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07239f8-0417-480d-ae7b-5cfad22c308d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e0e5ab2acc3425c9d820f2027f5652b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e36d923af474a07adb12209580f12e1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:40:29.390061 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0fa7a1-7166-4661-b5a1-6b5274ad9a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9501d798e8481da3be76351eec2bf6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:40:29.390561 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07239f8-0417-480d-ae7b-5cfad22c308d service placement] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:40:29.390693 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0fa7a1-7166-4661-b5a1-6b5274ad9a1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:40:29.390843 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07239f8-0417-480d-ae7b-5cfad22c308d service placement] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:40:29.390967 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0fa7a1-7166-4661-b5a1-6b5274ad9a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:40:29.391117 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07239f8-0417-480d-ae7b-5cfad22c308d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:40:29.391236 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0fa7a1-7166-4661-b5a1-6b5274ad9a1f admin admin] PATH_INFO: `/v3/users/b0142184cb824ec9840066ed12f7f27b` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:40:29.392598 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0fa7a1-7166-4661-b5a1-6b5274ad9a1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0142184cb824ec9840066ed12f7f27b)` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:40:29.394663 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0fa7a1-7166-4661-b5a1-6b5274ad9a1f admin admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:40:29.400449 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07239f8-0417-480d-ae7b-5cfad22c308d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:40:29.402074 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07239f8-0417-480d-ae7b-5cfad22c308d service placement] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:40:29.412570 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 636/1246] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 25 21:40:29 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 21:40:29.445740 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.notifications [None req-3d0fa7a1-7166-4661-b5a1-6b5274ad9a1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0142184cb824ec9840066ed12f7f27b'} {{(pid=87210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 21:40:29.458370 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.notifications [None req-3d0fa7a1-7166-4661-b5a1-6b5274ad9a1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0142184cb824ec9840066ed12f7f27b'} {{(pid=87210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 21:40:29.459064 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.notifications [None req-3d0fa7a1-7166-4661-b5a1-6b5274ad9a1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0142184cb824ec9840066ed12f7f27b'} {{(pid=87210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 21:40:29.468788 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.notifications [None req-3d0fa7a1-7166-4661-b5a1-6b5274ad9a1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0142184cb824ec9840066ed12f7f27b'} {{(pid=87210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 21:40:29.476904 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.notifications [None req-3d0fa7a1-7166-4661-b5a1-6b5274ad9a1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0142184cb824ec9840066ed12f7f27b'} {{(pid=87210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 21:40:29.483161 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 611/1247] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Jul 25 21:40:29 2022] DELETE /identity/v3/users/b0142184cb824ec9840066ed12f7f27b => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 21:40:29.667561 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07239f8-0417-480d-ae7b-5cfad22c308d service placement] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:40:29.680096 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07239f8-0417-480d-ae7b-5cfad22c308d service placement] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:40:29.742019 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ff9a8d-c813-4ba7-b85a-fdca377b6bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9501d798e8481da3be76351eec2bf6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:40:29.742679 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ff9a8d-c813-4ba7-b85a-fdca377b6bad admin admin] REQUEST_METHOD: `DELETE` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:40:29.742965 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ff9a8d-c813-4ba7-b85a-fdca377b6bad admin admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:40:29.743239 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ff9a8d-c813-4ba7-b85a-fdca377b6bad admin admin] PATH_INFO: `/v3/projects/a1d99d0047bd448d8281167c8f16e052` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:40:29.744428 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ff9a8d-c813-4ba7-b85a-fdca377b6bad admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1d99d0047bd448d8281167c8f16e052)` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:40:29.746424 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ff9a8d-c813-4ba7-b85a-fdca377b6bad admin admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:40:29.796877 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.notifications [None req-e3ff9a8d-c813-4ba7-b85a-fdca377b6bad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1d99d0047bd448d8281167c8f16e052', 'request_id': 'req-e3ff9a8d-c813-4ba7-b85a-fdca377b6bad'} {{(pid=87209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 21:40:29.803635 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.notifications [None req-e3ff9a8d-c813-4ba7-b85a-fdca377b6bad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1d99d0047bd448d8281167c8f16e052', 'request_id': 'req-e3ff9a8d-c813-4ba7-b85a-fdca377b6bad'} {{(pid=87209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 21:40:29.813575 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.notifications [None req-e3ff9a8d-c813-4ba7-b85a-fdca377b6bad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1d99d0047bd448d8281167c8f16e052', 'request_id': 'req-e3ff9a8d-c813-4ba7-b85a-fdca377b6bad'} {{(pid=87209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 21:40:29.825781 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.notifications [None req-e3ff9a8d-c813-4ba7-b85a-fdca377b6bad admin admin] The token cache is being invalidate because project a1d99d0047bd448d8281167c8f16e052 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 21:40:29.826071 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.notifications [None req-e3ff9a8d-c813-4ba7-b85a-fdca377b6bad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 21:40:29.826775 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.notifications [None req-e3ff9a8d-c813-4ba7-b85a-fdca377b6bad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 21:40:29.828468 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 637/1248] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Jul 25 21:40:29 2022] DELETE /identity/v3/projects/a1d99d0047bd448d8281167c8f16e052 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 21:40:29.832671 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0fa7a1-7166-4661-b5a1-6b5274ad9a1f admin admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:40:29.834258 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.fernet_utils [None req-3d0fa7a1-7166-4661-b5a1-6b5274ad9a1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:40:29.848201 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0fa7a1-7166-4661-b5a1-6b5274ad9a1f admin admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:40:29.874960 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:40:29.909437 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72381a71-6671-4b65-96aa-d719a8fba987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9501d798e8481da3be76351eec2bf6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:40:29.910085 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72381a71-6671-4b65-96aa-d719a8fba987 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:40:29.910365 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72381a71-6671-4b65-96aa-d719a8fba987 admin admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:40:29.910636 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72381a71-6671-4b65-96aa-d719a8fba987 admin admin] PATH_INFO: `/v3/users/1d7c8fd93aa64400a7516c5513c6dedf` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:40:29.911819 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72381a71-6671-4b65-96aa-d719a8fba987 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d7c8fd93aa64400a7516c5513c6dedf)` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:40:29.913801 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72381a71-6671-4b65-96aa-d719a8fba987 admin admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:40:29.965746 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.notifications [None req-72381a71-6671-4b65-96aa-d719a8fba987 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d7c8fd93aa64400a7516c5513c6dedf'} {{(pid=87210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 21:40:29.979400 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.notifications [None req-72381a71-6671-4b65-96aa-d719a8fba987 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d7c8fd93aa64400a7516c5513c6dedf'} {{(pid=87210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 21:40:29.980120 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.notifications [None req-72381a71-6671-4b65-96aa-d719a8fba987 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d7c8fd93aa64400a7516c5513c6dedf'} {{(pid=87210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 21:40:29.992558 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.notifications [None req-72381a71-6671-4b65-96aa-d719a8fba987 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d7c8fd93aa64400a7516c5513c6dedf'} {{(pid=87210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 21:40:30.000499 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.notifications [None req-72381a71-6671-4b65-96aa-d719a8fba987 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d7c8fd93aa64400a7516c5513c6dedf'} {{(pid=87210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 21:40:30.006911 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 612/1249] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Jul 25 21:40:29 2022] DELETE /identity/v3/users/1d7c8fd93aa64400a7516c5513c6dedf => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 21:40:30.206468 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ff9a8d-c813-4ba7-b85a-fdca377b6bad admin admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:40:30.208054 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-e3ff9a8d-c813-4ba7-b85a-fdca377b6bad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:40:30.221905 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ff9a8d-c813-4ba7-b85a-fdca377b6bad admin admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:40:30.273531 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:40:30.280991 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a42bd1-f390-4845-adfd-26660eb9fc3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9501d798e8481da3be76351eec2bf6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:40:30.281734 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a42bd1-f390-4845-adfd-26660eb9fc3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:40:30.282292 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a42bd1-f390-4845-adfd-26660eb9fc3f admin admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:40:30.282651 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a42bd1-f390-4845-adfd-26660eb9fc3f admin admin] PATH_INFO: `/v3/projects/d2a57df529354a1882a39b6d4ceb223f` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:40:30.283781 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a42bd1-f390-4845-adfd-26660eb9fc3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2a57df529354a1882a39b6d4ceb223f)` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:40:30.286379 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a42bd1-f390-4845-adfd-26660eb9fc3f admin admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:40:30.337098 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.notifications [None req-86a42bd1-f390-4845-adfd-26660eb9fc3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2a57df529354a1882a39b6d4ceb223f', 'request_id': 'req-86a42bd1-f390-4845-adfd-26660eb9fc3f'} {{(pid=87209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 21:40:30.342550 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.notifications [None req-86a42bd1-f390-4845-adfd-26660eb9fc3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2a57df529354a1882a39b6d4ceb223f', 'request_id': 'req-86a42bd1-f390-4845-adfd-26660eb9fc3f'} {{(pid=87209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 21:40:30.350937 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.notifications [None req-86a42bd1-f390-4845-adfd-26660eb9fc3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2a57df529354a1882a39b6d4ceb223f', 'request_id': 'req-86a42bd1-f390-4845-adfd-26660eb9fc3f'} {{(pid=87209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 21:40:30.362658 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.notifications [None req-86a42bd1-f390-4845-adfd-26660eb9fc3f admin admin] The token cache is being invalidate because project d2a57df529354a1882a39b6d4ceb223f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 21:40:30.363223 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.notifications [None req-86a42bd1-f390-4845-adfd-26660eb9fc3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 21:40:30.363979 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.notifications [None req-86a42bd1-f390-4845-adfd-26660eb9fc3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 21:40:30.365685 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 638/1250] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Jul 25 21:40:30 2022] DELETE /identity/v3/projects/d2a57df529354a1882a39b6d4ceb223f => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 21:40:40.003177 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=41,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:40:40.359372 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=25,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:41:03.775873 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8319a460-7818-4146-9333-6c3de92ec577 None None] REQUEST_METHOD: `POST` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:41:03.776409 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8319a460-7818-4146-9333-6c3de92ec577 None None] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:41:03.776409 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8319a460-7818-4146-9333-6c3de92ec577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:41:03.796573 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.auth.core [None req-8319a460-7818-4146-9333-6c3de92ec577 None None] MFA Rules not processed for user `b248db46f9ef442ebf585f91397e71c3`. Rule list: `[]` (Enabled: `True`). {{(pid=87210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:41:03.798005 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.fernet_utils [None req-8319a460-7818-4146-9333-6c3de92ec577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:41:03.860962 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 613/1251] 10.222.0.66 () {58 vars in 958 bytes} [Mon Jul 25 21:41:03 2022] POST /identity/v3/auth/tokens => generated 2804 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:41:04.194190 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a42bd1-f390-4845-adfd-26660eb9fc3f admin admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:41:04.195853 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-86a42bd1-f390-4845-adfd-26660eb9fc3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:41:04.255860 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a42bd1-f390-4845-adfd-26660eb9fc3f admin admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:41:04.260070 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be824111-37e3-44fa-b7cf-fc47021da2c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '704ea1ca162d4df3ab560d910d599851', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e36d923af474a07adb12209580f12e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:41:04.260695 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be824111-37e3-44fa-b7cf-fc47021da2c2 service neutron] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:41:04.260967 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be824111-37e3-44fa-b7cf-fc47021da2c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:41:04.261335 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be824111-37e3-44fa-b7cf-fc47021da2c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:41:04.263240 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-be824111-37e3-44fa-b7cf-fc47021da2c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:41:04.273051 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be824111-37e3-44fa-b7cf-fc47021da2c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:41:04.275008 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be824111-37e3-44fa-b7cf-fc47021da2c2 service neutron] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:41:04.282913 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 639/1252] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 25 21:41:04 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:41:04.758981 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8319a460-7818-4146-9333-6c3de92ec577 None None] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:41:04.760538 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.fernet_utils [None req-8319a460-7818-4146-9333-6c3de92ec577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:41:04.834245 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8319a460-7818-4146-9333-6c3de92ec577 None None] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:41:04.839296 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a85e8b-4615-4270-9d5a-0533a0722a96 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e0e5ab2acc3425c9d820f2027f5652b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e36d923af474a07adb12209580f12e1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:41:04.839923 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a85e8b-4615-4270-9d5a-0533a0722a96 service placement] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:41:04.840204 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a85e8b-4615-4270-9d5a-0533a0722a96 service placement] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:41:04.840506 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a85e8b-4615-4270-9d5a-0533a0722a96 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:41:04.842257 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.fernet_utils [None req-03a85e8b-4615-4270-9d5a-0533a0722a96 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:41:04.853836 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a85e8b-4615-4270-9d5a-0533a0722a96 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:41:04.855459 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a85e8b-4615-4270-9d5a-0533a0722a96 service placement] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:41:04.865336 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 614/1253] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 25 21:41:04 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:41:14.279748 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=26 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:41:14.613616 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be824111-37e3-44fa-b7cf-fc47021da2c2 service neutron] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:41:14.615308 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-be824111-37e3-44fa-b7cf-fc47021da2c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:41:14.690959 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be824111-37e3-44fa-b7cf-fc47021da2c2 service neutron] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:41:14.696646 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2dcaa4-3a7a-4e4b-9815-03882a69b68f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '524584f0d1b64e02a467b47de395c130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e36d923af474a07adb12209580f12e1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:41:14.697302 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2dcaa4-3a7a-4e4b-9815-03882a69b68f service nova] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:41:14.697577 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2dcaa4-3a7a-4e4b-9815-03882a69b68f service nova] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:41:14.697846 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2dcaa4-3a7a-4e4b-9815-03882a69b68f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:41:14.699769 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-7b2dcaa4-3a7a-4e4b-9815-03882a69b68f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:41:14.712291 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2dcaa4-3a7a-4e4b-9815-03882a69b68f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:41:14.713920 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2dcaa4-3a7a-4e4b-9815-03882a69b68f service nova] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:41:14.723429 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 640/1254] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 25 21:41:14 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:41:14.861239 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=57 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:41:24.719548 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=32 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:11.689608 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a85e8b-4615-4270-9d5a-0533a0722a96 service placement] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:11.743284 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a85e8b-4615-4270-9d5a-0533a0722a96 service placement] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:11.749579 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dec85aa-47e5-4aca-b2f4-27eb3084858a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '524584f0d1b64e02a467b47de395c130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e36d923af474a07adb12209580f12e1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:11.750464 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dec85aa-47e5-4aca-b2f4-27eb3084858a service nova] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:11.751312 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dec85aa-47e5-4aca-b2f4-27eb3084858a service nova] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:11.751550 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dec85aa-47e5-4aca-b2f4-27eb3084858a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:11.753876 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.fernet_utils [None req-2dec85aa-47e5-4aca-b2f4-27eb3084858a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:43:11.798645 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dec85aa-47e5-4aca-b2f4-27eb3084858a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:11.800661 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dec85aa-47e5-4aca-b2f4-27eb3084858a service nova] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:11.814447 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 615/1255] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 25 21:43:11 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:43:14.243601 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2dcaa4-3a7a-4e4b-9815-03882a69b68f service nova] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:14.307219 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2dcaa4-3a7a-4e4b-9815-03882a69b68f service nova] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:14.313842 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8489c03-9350-4a38-93e1-a58e5364f07b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e0e5ab2acc3425c9d820f2027f5652b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e36d923af474a07adb12209580f12e1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:14.314791 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8489c03-9350-4a38-93e1-a58e5364f07b service placement] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:14.315062 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8489c03-9350-4a38-93e1-a58e5364f07b service placement] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:14.315380 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8489c03-9350-4a38-93e1-a58e5364f07b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:14.320519 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-d8489c03-9350-4a38-93e1-a58e5364f07b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:43:14.339920 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8489c03-9350-4a38-93e1-a58e5364f07b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:14.341670 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8489c03-9350-4a38-93e1-a58e5364f07b service placement] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:14.353471 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 641/1256] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 25 21:43:14 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:43:21.809439 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=28 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:24.349348 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=20 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:54.449331 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dec85aa-47e5-4aca-b2f4-27eb3084858a service nova] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:54.459557 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dec85aa-47e5-4aca-b2f4-27eb3084858a service nova] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:54.463602 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0b8c84-4e4b-4624-aee3-c68df9ce794e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '704ea1ca162d4df3ab560d910d599851', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e36d923af474a07adb12209580f12e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:54.464202 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0b8c84-4e4b-4624-aee3-c68df9ce794e service neutron] REQUEST_METHOD: `GET` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:54.464483 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0b8c84-4e4b-4624-aee3-c68df9ce794e service neutron] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:54.464814 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0b8c84-4e4b-4624-aee3-c68df9ce794e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:54.466640 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.fernet_utils [None req-6c0b8c84-4e4b-4624-aee3-c68df9ce794e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:43:54.565506 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0b8c84-4e4b-4624-aee3-c68df9ce794e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:54.566956 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0b8c84-4e4b-4624-aee3-c68df9ce794e service neutron] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:54.576730 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 616/1257] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 25 21:43:54 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:44:01.126881 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8489c03-9350-4a38-93e1-a58e5364f07b service placement] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:01.128450 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-d8489c03-9350-4a38-93e1-a58e5364f07b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:44:01.143745 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8489c03-9350-4a38-93e1-a58e5364f07b service placement] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:01.149337 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66f0e9e-82af-44f2-bff9-fd74a0f6eef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9501d798e8481da3be76351eec2bf6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:01.150183 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66f0e9e-82af-44f2-bff9-fd74a0f6eef0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:01.150433 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66f0e9e-82af-44f2-bff9-fd74a0f6eef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:01.150746 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66f0e9e-82af-44f2-bff9-fd74a0f6eef0 admin admin] PATH_INFO: `/v3/users/b248db46f9ef442ebf585f91397e71c3` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:01.165553 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66f0e9e-82af-44f2-bff9-fd74a0f6eef0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b248db46f9ef442ebf585f91397e71c3)` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:44:01.166596 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: WARNING py.warnings [None req-c66f0e9e-82af-44f2-bff9-fd74a0f6eef0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 21:44:01.166596 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: warnings.warn(msg) Jul 25 21:44:01.166596 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: Jul 25 21:44:01.167825 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66f0e9e-82af-44f2-bff9-fd74a0f6eef0 admin admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:44:01.231281 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.notifications [None req-c66f0e9e-82af-44f2-bff9-fd74a0f6eef0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b248db46f9ef442ebf585f91397e71c3'} {{(pid=87209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 21:44:01.231957 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.notifications [None req-c66f0e9e-82af-44f2-bff9-fd74a0f6eef0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b248db46f9ef442ebf585f91397e71c3'} {{(pid=87209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 21:44:01.241270 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.notifications [None req-c66f0e9e-82af-44f2-bff9-fd74a0f6eef0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b248db46f9ef442ebf585f91397e71c3'} {{(pid=87209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 21:44:01.241913 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.notifications [None req-c66f0e9e-82af-44f2-bff9-fd74a0f6eef0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b248db46f9ef442ebf585f91397e71c3'} {{(pid=87209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 21:44:01.252087 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.notifications [None req-c66f0e9e-82af-44f2-bff9-fd74a0f6eef0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b248db46f9ef442ebf585f91397e71c3'} {{(pid=87209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 21:44:01.278488 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 642/1258] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Jul 25 21:44:01 2022] DELETE /identity/v3/users/b248db46f9ef442ebf585f91397e71c3 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 21:44:01.461688 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0b8c84-4e4b-4624-aee3-c68df9ce794e service neutron] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:01.471985 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0b8c84-4e4b-4624-aee3-c68df9ce794e service neutron] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:01.531927 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c12c20-c85b-48a6-a4df-33704636b62d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9501d798e8481da3be76351eec2bf6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:01.532580 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c12c20-c85b-48a6-a4df-33704636b62d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:01.532858 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c12c20-c85b-48a6-a4df-33704636b62d admin admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:01.533175 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c12c20-c85b-48a6-a4df-33704636b62d admin admin] PATH_INFO: `/v3/projects/d588a38c62e7412e84b10df904a6faee` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:01.543993 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c12c20-c85b-48a6-a4df-33704636b62d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d588a38c62e7412e84b10df904a6faee)` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:44:01.545031 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: WARNING py.warnings [None req-59c12c20-c85b-48a6-a4df-33704636b62d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 21:44:01.545031 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: warnings.warn(msg) Jul 25 21:44:01.545031 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: Jul 25 21:44:01.547302 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c12c20-c85b-48a6-a4df-33704636b62d admin admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:44:01.614313 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.notifications [None req-59c12c20-c85b-48a6-a4df-33704636b62d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd588a38c62e7412e84b10df904a6faee', 'request_id': 'req-59c12c20-c85b-48a6-a4df-33704636b62d'} {{(pid=87210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 21:44:01.622737 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.notifications [None req-59c12c20-c85b-48a6-a4df-33704636b62d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd588a38c62e7412e84b10df904a6faee', 'request_id': 'req-59c12c20-c85b-48a6-a4df-33704636b62d'} {{(pid=87210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 21:44:01.637837 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.notifications [None req-59c12c20-c85b-48a6-a4df-33704636b62d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd588a38c62e7412e84b10df904a6faee', 'request_id': 'req-59c12c20-c85b-48a6-a4df-33704636b62d'} {{(pid=87210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 21:44:01.641830 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:44:01.653523 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.notifications [None req-59c12c20-c85b-48a6-a4df-33704636b62d admin admin] The token cache is being invalidate because project d588a38c62e7412e84b10df904a6faee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 21:44:01.653808 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.notifications [None req-59c12c20-c85b-48a6-a4df-33704636b62d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 21:44:01.655023 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.notifications [None req-59c12c20-c85b-48a6-a4df-33704636b62d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 21:44:01.656735 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 617/1259] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Jul 25 21:44:01 2022] DELETE /identity/v3/projects/d588a38c62e7412e84b10df904a6faee => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 21:44:01.660885 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66f0e9e-82af-44f2-bff9-fd74a0f6eef0 admin admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:01.662336 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-c66f0e9e-82af-44f2-bff9-fd74a0f6eef0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:44:01.676218 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66f0e9e-82af-44f2-bff9-fd74a0f6eef0 admin admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:01.739077 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d8fae8-3c92-4dee-8a95-d82df4246ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9501d798e8481da3be76351eec2bf6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:01.739738 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d8fae8-3c92-4dee-8a95-d82df4246ffb admin admin] REQUEST_METHOD: `DELETE` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:01.740024 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d8fae8-3c92-4dee-8a95-d82df4246ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:01.740298 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d8fae8-3c92-4dee-8a95-d82df4246ffb admin admin] PATH_INFO: `/v3/users/c7db724c32c04f2bb67e3cb409261769` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:01.754169 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d8fae8-3c92-4dee-8a95-d82df4246ffb admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7db724c32c04f2bb67e3cb409261769)` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:44:01.756136 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d8fae8-3c92-4dee-8a95-d82df4246ffb admin admin] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:44:01.812746 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.notifications [None req-28d8fae8-3c92-4dee-8a95-d82df4246ffb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7db724c32c04f2bb67e3cb409261769'} {{(pid=87209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 21:44:01.813421 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.notifications [None req-28d8fae8-3c92-4dee-8a95-d82df4246ffb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7db724c32c04f2bb67e3cb409261769'} {{(pid=87209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 21:44:01.817103 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:44:01.821901 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.notifications [None req-28d8fae8-3c92-4dee-8a95-d82df4246ffb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7db724c32c04f2bb67e3cb409261769'} {{(pid=87209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 21:44:01.822629 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.notifications [None req-28d8fae8-3c92-4dee-8a95-d82df4246ffb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7db724c32c04f2bb67e3cb409261769'} {{(pid=87209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 21:44:01.831981 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.notifications [None req-28d8fae8-3c92-4dee-8a95-d82df4246ffb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7db724c32c04f2bb67e3cb409261769'} {{(pid=87209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 21:44:01.849986 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 643/1260] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Jul 25 21:44:01 2022] DELETE /identity/v3/users/c7db724c32c04f2bb67e3cb409261769 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 21:44:02.026671 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c12c20-c85b-48a6-a4df-33704636b62d admin admin] Authenticating user token {{(pid=87210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:02.028157 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.fernet_utils [None req-59c12c20-c85b-48a6-a4df-33704636b62d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:44:02.042868 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c12c20-c85b-48a6-a4df-33704636b62d admin admin] Validating token access rules against request {{(pid=87210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:02.109403 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0691b0c-906e-48a0-b468-6891d06aef7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e6cadb2f0fe422088a106e6a578b2f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa9501d798e8481da3be76351eec2bf6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:02.110150 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0691b0c-906e-48a0-b468-6891d06aef7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:02.110430 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0691b0c-906e-48a0-b468-6891d06aef7e admin admin] SCRIPT_NAME: `/identity` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:02.110697 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0691b0c-906e-48a0-b468-6891d06aef7e admin admin] PATH_INFO: `/v3/projects/89bc252d833141e499a64fc401927091` {{(pid=87210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:02.121501 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0691b0c-906e-48a0-b468-6891d06aef7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=89bc252d833141e499a64fc401927091)` {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:44:02.124341 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0691b0c-906e-48a0-b468-6891d06aef7e admin admin] RBAC: Authorization granted {{(pid=87210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:44:02.192179 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.notifications [None req-e0691b0c-906e-48a0-b468-6891d06aef7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89bc252d833141e499a64fc401927091', 'request_id': 'req-e0691b0c-906e-48a0-b468-6891d06aef7e'} {{(pid=87210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 21:44:02.197701 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.notifications [None req-e0691b0c-906e-48a0-b468-6891d06aef7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89bc252d833141e499a64fc401927091', 'request_id': 'req-e0691b0c-906e-48a0-b468-6891d06aef7e'} {{(pid=87210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 21:44:02.204578 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.notifications [None req-e0691b0c-906e-48a0-b468-6891d06aef7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89bc252d833141e499a64fc401927091', 'request_id': 'req-e0691b0c-906e-48a0-b468-6891d06aef7e'} {{(pid=87210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 21:44:02.218907 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.notifications [None req-e0691b0c-906e-48a0-b468-6891d06aef7e admin admin] The token cache is being invalidate because project 89bc252d833141e499a64fc401927091 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 21:44:02.219191 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.notifications [None req-e0691b0c-906e-48a0-b468-6891d06aef7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 21:44:02.219844 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG keystone.notifications [None req-e0691b0c-906e-48a0-b468-6891d06aef7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 21:44:02.221354 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: [pid: 87210|app: 0|req: 618/1261] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Jul 25 21:44:02 2022] DELETE /identity/v3/projects/89bc252d833141e499a64fc401927091 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 21:44:11.846578 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG dbcounter [-] [87209] Writing DB stats keystone:SELECT=12,keystone:DELETE=2 {{(pid=87209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:44:12.216199 dv-osbrick-849018-3-ceph devstack@keystone.service[87210]: DEBUG dbcounter [-] [87210] Writing DB stats keystone:SELECT=57,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:48:20.502443 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d8fae8-3c92-4dee-8a95-d82df4246ffb admin admin] Authenticating user token {{(pid=87209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:48:20.504152 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-28d8fae8-3c92-4dee-8a95-d82df4246ffb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:48:20.591445 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d8fae8-3c92-4dee-8a95-d82df4246ffb admin admin] Validating token access rules against request {{(pid=87209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:48:20.663286 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e153e5a2-46b5-4475-8567-671389b9c05a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e0e5ab2acc3425c9d820f2027f5652b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e36d923af474a07adb12209580f12e1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:48:20.663915 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e153e5a2-46b5-4475-8567-671389b9c05a service placement] REQUEST_METHOD: `GET` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:48:20.664191 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e153e5a2-46b5-4475-8567-671389b9c05a service placement] SCRIPT_NAME: `/identity` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:48:20.664460 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e153e5a2-46b5-4475-8567-671389b9c05a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:48:20.666768 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.fernet_utils [None req-e153e5a2-46b5-4475-8567-671389b9c05a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:48:20.679498 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e153e5a2-46b5-4475-8567-671389b9c05a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:48:20.681105 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e153e5a2-46b5-4475-8567-671389b9c05a service placement] RBAC: Authorization granted {{(pid=87209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:48:20.691600 dv-osbrick-849018-3-ceph devstack@keystone.service[87209]: [pid: 87209|app: 0|req: 644/1262] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 25 21:48:20 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)